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Each 
chapter 


report is such .that there is a separate appendix 
appendix contains those visual aids which pertain 
and is used as a set of supporting tables tor 


I 

I 


A Arthur D. Little. Inc. 


ii 



I 


Weather Forecasting Expert System Study 


Final Report 


to 


National Aeronautics and Space Administration 


Kennedy Space Center 


December 1985 


/ti Arthur D. Little. Inc. 


Table of Contents 


Title Page 

Acknowledgements i 

Preface ii 

Executive Summary 1 

0. Introduction 3 

Background 3 

Objectives 3 

Scope 3 

Approach 3 

1. Weather Dependent STS Processing Functions 4 

1.1 Forecasting Support 4 

1.2 Major Events 4 

1.3 Day-to-day Activities 4 

2. Key Weather Scenarios at NASA KSC 5 

2.1 Critical Weather Phenomena 5 

2.2 Important Weather Scenarios 3 

2.3 Potential WFES Subjects 6 

1 3. Forecasting Methods 7 

3.1 Seasonal Dependency 7 

3.2 Summer Forecasting 7 

} 3.3 Analogical Reasoning 8 

4. Pattern Recognition Techniques 9 

4.1 Overview 9 

4.2 Algorithms 9 

4.3 Forecaster Expertise 10 

5. Data Systems and Tools 11 

5.1 CCFF Systems 11 

5.2 WFES Workstation Technology 12 

5.3 WFES Hardware and Software 12 

6. Prototype Weather Forecasting Expert System 14 

6.1 Option Evaluation 14 

6.2 System Design 15 

6.3 Development Approach 17 

6.4 Prototype Options 17 

6.4.1 Option 1: High Effort 18 

6.4.2 Option 2: Medium Effort 18 


/L Arthur D. Little. Inc. 


Table of Contents 


Title 


appendix 0 

EXECUTIVE SUMMARY AND INTRODUCTION 

APPENDIX 1 

TASK 1 ; 

WEATHER DEPENDENT STS PROCESSING FUNCTIONS 

APPENDIX 2 

TASK 2: 

KEY WEATHER SCENARIOS AT NASA KSC 

APPENDIX 3 

TASK 3: 

FORECASTING METHODS 

APPENDIX 4 

TASK 4: 

PATTERN RECOGNITION TECHNIQUES 

APPENDIX 5 

TASK 5: 

DATA SYSTEMS AND TOOLS 

APPENDIX 6 

TASK 6: 

PROTOTYPE WEATHER FORECASTING EXPERT SYSTEM 


Pa £ e 

0-1 

1-1 

2-1 

3- 1 

4- 1 

5- 1 

6 - 1 


Ai Arthur D. Little. Inc. 


Executive Summary 


Weather forecasting is critical to both the Space Transportation System (STS) 
ground operations and the launch /landing activities at NASA Kennedy Space 
Center (KSC). The current launch frequency places significant demands on the 
USAF weather forecasters at the Cape Canaveral Forecasting Facility (CCFF) , 
currently provide the weather forecasting for all STS operations* As 
launch frequency increases, KSC ' s weather forecasting problems will be greatly 
magnified . 

The single most important problem is the shortage of highly skilled 
forecasting personnel. The development of forecasting expertise is difficult 
and requires several years of experience for a number of reasons: 

• Climatological conditions at KSC are unique because of its geographic 
location. 

• Validated numerical models are not available for mesoscale (within 30 
miles) nowcasting (next 6 hours) at KSC, therefore accumulated 
experience is the major basis for forecasting expertise. 

• Unique data systems are being installed at CCFF which take time to 
master and integrate with traditional forecasting methods. 

Frequent personnel changes within the forecasting staff jeopardize the 
accumulation and retention of experience-based weather forecasting expertise. 

The primary purpose of this project was to assess the feasibility o. using 
Artificial Intelligence (AI) techniques to ameliorate this shortage of experts 
by capturing and incorporating the forecasting knowledge of current expert 
forecasters into a Weather Forecasting Expert System (WFES) which would then 
be made available to less experienced duty forecasters. The determination of 
feasibility hinged on answering the following questions: 

• Are there people in the Cape area who are recognized as being 
significantly better weather forecasters than others? 

• What is the nature of their expertise? 

• Are currently available AI techniques adequate to capture and automate 
this expertise? 

• What is the best way to evaluate the technical and economic 
feasibility of building a WFES? 
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After numerous interviews with duty forecasters, staff meteorologists, NASA 
personnel and outside experts, a handful of people were identified as being 
more expert than others at forecasting the weather at KSC. A distinguishing 
characteristic of these experts emerged: the high degree to which each has 

formulated his day-to-day forecasting experiences into usable "scenarios or, 
to use a meteorological term, "analogs". These scenarios are technical 
stories abstracted from past weather patterns that the forecaster has 
encountered. The are subsequently used as hypotheses to guide and direct the 
development of a current forecast. An experienced forecaster often entertains 

several scenarios concurrently. 


No single AI technique is adequate to. represent these scenarios in an expert 
system. However, a compound knowledge representation scheme was developed 
that combines a significant number of the most frequently used representation 
techniques in applied AI: rules, objects, predicates, and causal models. 

Based on preliminary knowledge engineering, a control logic ( inference 
engine") also was proposed that mirrors how experienced forecasters appear to 
utilize scenarios in predicting the weather. 


An evaluation was done of the degree to which AI -based pattern recognition 
should play a role in the WFES. It was concluded that automatic recognition 
of complex patterns in CCFF's data streams represents a very large R&D effort 
unrelated to the question of whether forecasting expertise can be captured and 
automated. The proposed WFES design relies upon the forecasters to identify 
abstract patterns, but does so in a way that will allow it to be interfaced to 
pattern recognition programs when such become available. 


To evaluate the proposed system design, a two-year development plan was 
presented to build a proo f-o f-concept WFES that focuses on capturing and 
encoding scenarios related to the formation of thunderstorms within 5 miles of 
KSC Thunderstorms were chosen because of the skill required to predict them 
accurately, and because they contain all of the weather events that have a 
major impact on STS operations. Two expert weather forecasters were 
identified for use as domain experts. Two versions of the plan were presented 
representing different levels-o f-eff ort; a stand-alone WFES (medium effort); a 
WFEs tightly coupled to the MIDDS system (large effort). 
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Introduction 


Background 

The geographical location of Kennedy Space Center and tne nature of tne Space 
Transport System (STS) mission make weather forecasting a difficult and 
important problem. Weather regimes range from temperate to tropical during 
the course of a year, often resulting in unique weather systems. Due to tne 
'complexity of STS operations, forecasts must be both spatially and temporally 
more precise than is typical. Extensive data systems have been installed to 
aid the forecasters at the Cape Canaveral Forecasting Facility (CCFF), but 
mastering the use of those systems requires additional training. Much of the 
forecasting expertise developed at KSC is regularly lost due to the frequent 
turnover of Air Force personnel at CCFF, who are responsible for all 
KSC-specific weather forecasting in support of STS operations. 

Ob j ec t ives 

Tne primary objective was to determine the feasibility of using AI techniques 
to capture and encode the expertise that presently exists witnin expert 
weather forecasters at KSC. Once feasibility had been established, a plan was 
to be developed for the development of a prototype Weather Forecasting Expert 
System (WFES). 


Scope 


The primary sources of information about the STS requirements and 
forecasting processes were two domain experts identified by NASA, 
interviews were conducted with Air Force staff, and documents were 
for analysis whenever available. 


the weather 
Additional 
collected 


Approach 

The evaluation and feasibility study was to cover STS processing functions, 
key weather scenarios, forecasting methods, pattern recognition and data 
systems and tools. A plan was to be developed for the construction of a 
prototype WFES. 
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1. WEATHER DEPENDENT STS PROCESSING FUNCTIONS 


1.1 Forecasting Support 

The Cape Canaveral Forecasting Facility (CCFF) of the USAF provides 
meteorological support for a large number of programs and agencies in the 
coastal areas of Florida, in addition to Its support role for the STS 
program. CCFF's responsibilities include range safety, recovery forces (air 
and sea), ESMC operations, Aerostat, Navy, Patrick AFB 3rd shift, and the 
bombing range. Each of CCFF's customers has a different set of forecasting 
requirements. 

There are two general classes of weather sensitive operations associated with 
the STS program. One group centers around major Shuttle events such as launch 
and land operations. The second group relates to the day-to-day tasks that 
are part of the processing activities between major events. 

1. 2 Major Events 

The weather constraints related to the major STS events, briefly summarized in 
the Appendix 1, are well -specif ied and are generally familiar to even the 
newest duty forecaster. CCFFs best meteorological support is provided for 
these events. The most senior forecasters are present to support these 
operations, and extra personnel are added to the normal contingent of duty 
forecasters. However, the current launch frequency taxes the present capacity 
of the staff. The basic problem is a shortage of experienced staff, and this 
problem will become more serious as launch frequency increases over the coming 
years. Furthermore, the assignment of expert staff to m major events results 
in the day-to-day operations being staffed by less experienced forecasters. 

1.3 Day-to-day Activities 

The weather constraints associated with the day-to-day processing activities 
are less well specified and almost unknown to the CCFF duty forecasters. We 
were unable to find a complete list of these activities within NAS^, and 
compiling such a list was outside the scope of this project. 

An examination of the Safety Operating Procedures manual gave some inkling of 
the number of these tasks. Of 65 topics, 52 require warnings of storms with 
lightning; 18 have additional meteorological constraints. Only four of these 
topics have formally-specified procedures for CCFF to follow in issuing 
specific forecasts. 

Interviews with the NASA STS processing expert generated a number of examples 
of ground processing tasks, such as spray painting and electrical work, which 
are very weather sensitive but not explicitly covered by policy. From the 
launch director's point of view, the most serious scheduling problems result 
from the cummulative effects of day-to-day interruptions of such tasks. Yet, 
the meteorological support for these activities is the least-developed within 
the CCFF. 
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2. KEY WEATHER SCENARIOS AT NASA KSC 


2. l Critical Weather Phenomena 

To the extent possible, STS operations at KSC have been designed and 
engineered so that they are minimally affected by local weather conditions. 
Even so, a wide variety of STS-related activities are quite sensitive to 
weather, often in ways which are unique to the requirements of KSC s STS 
responsibilities. Overall, the biggest operational problems are posed y 
lightning, wind and precipitation, in that order. Fog, althoug tra i ^ona , 
a major aviation concern, only occasionally affects KSC operations. 

Lightning protection across KSC is elaborate and effective to the extent 
possible. One indication of the importance of lightning is that a NAS^ 
lightning expert is present at CCFF during all launch and landing operations. 
The development and installation of better sensing devices (e.g., field mills) 
for both the detection and prediction of lightning are important parts of 
current NASA development projects. However, the expertise required f 
proper use and interpretation of existing data has not been fully developed or 

tranferred to CCFF forecasters. 

Wind is a critical factor in landings because there is only one STS runway at 
KSC It is also a very important factor during launch because of the shearing 
forces it can generate on the shuttle. Wind also poses a particular safety 
problem for individuals on towers and for handlers of propellants, 
presents a problem for sensitive STS payloads because of dust. 

Again the installation and expansion of the mesonet system is an important 
part of the meteorological improvement plan at KSC. The duty forecasters a 
CCFF appear to have made considerable progress in integrating the mesonet data 
into their forecast development process. However, much more work is needed to 
understand how the data are best used. 


2.2 Important Weather Scenarios 


For STS operations, the most 
convective activity in summer 
seasons; and the approach and 


important weather scenarios vary by season: 
; fog and low visibility in the transition 
stagnation cf frontal systems in winter. 


Thunderstorms are often imbedded in frontal systems. Summer thunderstorm 
formation is particularly difficult to forecast because of its small^cale 
irregularity as well as its sensitivity to mesoscale effects which vary on a 
daily cycle. National forecasting products (such as the LFM) are of little 
use during the summer, although they are important in forecasting winter 

t hunderstorms 
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2.3 Potential WFES Subjects 


A wide variety of potential weather topics were considered in deciding on the 
target subject matter for the WFES. Some of these topics are comparatively 
simple in tnat they are concerned with a specific phenomenon, such as 
precipitation. Other topics are more complex because they focus on compound 
conditions, such as frontal activity, which are less easy to characterize. A 
complete list of candidate WFES subjects is contained in Appendix 2. 

A number of questions were posed as a way of evaluating which specific weat.icr 
topic should be the basis of tne WFES initial project: 

• How serious an operational problem does it pose? 

• Does significant expertise exist at KSC or CCFF? 

• How frequently does the phenomenon occur? 

• Are CCFF-spec i f ic data sources required? 

• Is KSC forecasting experience essential to forecast it accurately? 

• How well is the forecasting problem bounded? 

A discussion of the pros and cons concerning each WFES topic is provided in 
Appendix 2. The following is a summary of the rationale for selecting summer 
thunderstorms . 

Thunderstorms contain all three of the phenomena that have the greatest impact 
on both major and day-to-day STS operations: lightning, wind and rain. 

Forecasting summer thunderstorm formation minimally requires several seasons 
of experience at KSC and depends heavily upon CCFF s unique data sources, man^ 
of which require considerable experience before proficiency is developed. Tne 
process of forecasting thunderstorms is complex and requires the forecaster to 
assimilate information from almost all of the CCFF s data sources. On tne 
other hand, it is a highly structured problem due to the diurnal cycle of 
storm formation. Finally, there are several forecasters wno possess valuable 
expertise in this area. 
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3. FORECASTING METHODS 


3.1 Seasonal Dependency 

Forecasting methods used at CCFF differ drastically from season to season 
(Appendix 3). In general, the primary difference is the degree to which 
mid-latitude techniques are appropriate: 

• Winter forecasting presents problems for which Air Force personnel are 
well-prepared, mainly because synoptic effects dominate and standard 
guidance products are useful. 

• Summer forecasting is much more difficult, not only because mesoscale 
effects dominate and few guidance products are reliable, but also 
because few of the Air Force personnel have had previous forecasting 
experience in a tropical regime. 

Because the focus of the initial WFES will be on thunderstorms, this report 
focuses on the methods used in forecasting during the summertime 

3.2 Summer Forecasting 

Broadly speaking, forecasting during the summertime is characterized by four 
primary methods: 

• climatology; 

• product evaluation; 

• detection and monitoring of mesoscale features; and 

• analogical reasoning. 

Climatology should be thought of as providing a starting point for the day 
rather than as an alternate prediction method. That is, climatology provides 
constraints which serve as a background against which a forecaster makes a set 
of predictions. For example, there Is a regression model at CCFF which 
predicts the likelihood of lightning each day based upon the morning sounding; 
if the model indicates a high likelihood of lightning that day, the forecaster 
is liable to be more alert to thunderstorm development, but will almost surely 
not base a forecast on the prediction from the regression equations. 

The national products available at CCFF consist largely of output from 
synoptic-scale computer models; a lone exception is the TROPAN chart from the 
National Hurricane Center showing inferred wind fields in the tropics. 
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Aside from TROPAN , the evaluation of national products is rarely of direct 
help during tne summer montns. Nevertheless, forecasters almost always begin 
their shifts by examining those products to obtain a broad overview of t e 
current situation at the synoptic scale. 

Detection and monitoring of specific mesoscale features occupies most of tne 
forecaster's available time and energy. This is normally a quiet task whicn 
becomes hectic only when there is significant convection in tne area. 
Unfortunately, the presence of thunderstorms usually triggers a large " u f" 
of telephone calls and clerical activities precisely at a time wnen all , t . 
forecaster's efforts snould be devoted to a minute-by-minute monitoring of tne 
current situation. 


3.3 Analogical Reasoning 

Analogical reasoning involves the comparison of current events with specific 
forecaster experiences. It is a highly abstract activity, and is the hallmark 
of the very best forecasters. As we have observed it, analogical reasoning 
includes three main stages: 

• classifying today's conditions and identifying them with one or more 
specific scenarios; 

• anticipating future events implied by those scenarios; 

• verifying that the behavior of each scenario corresponds roughly with 
how today*s conditions are evolving. 

Furthermore, the forecaster's concept of these scenarios is dynamic rather 
than static. That is, the description of each scenario is continuously 
updated and modified as time goes by; current scenarios are rejected, and new 
scenarios created, according to how tne day is evolving. In other words, 
analogical reasoning is iterative, and a forecaster may go through the tnree 
stages mentioned above a dozen or more times during a single snirt. 

Summer forecasting is based upon analogical reasoning because discrete 
scenarios provide the forecaster with a conceptual framework. That is, 
consideration of individual scenarios focuses the forecaster's attention on 
that data which is most critical to recognizing and interpreting today s 
significant weather patterns. To some degree, it may be considered an 
abstract filtering process which allows the forecaster to ignore tne vast 
maiority of data which is available, and concentrate on those subsets which 
are most likely to help discern the direction of development of current 

conditions • 

The most expert forecasters often maintain competing scenarios which describe 
the general range of possible outcomes during the next several hours. There 
appears to be some communication of these scenarios between duty forecasters, 
both in formal documents as well as during shift-change briefings, but it is 
rather cursory and incomplete. Tne incompleteness of communication is not 
because of a lack of interest, but appears to be due to the ditficulty or 
verbally transcribing tne contents of a scenario. 
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4. PATTERN RECOGNITION TECHNIQUES 


4.1 Overview 

The timely recognition of specific patterns is one of the most fundamental 
tasks of nowcasting, especially summertime nowcasting in the Cape Canaveral 
area. Sea-breeze onset and severe-weather signatures in vertical soundings 
3^*0 examples of patterns which most concern CCFF forecasters. Welx trained 
forecasters were found to be very adept at recognizing such patterns and 
interpreting their implications for short-range developments. 

The data sources available to CCFF provide a rich source of information for 
detecting patterns which are of interest to the forecaster. Expert 
forecasters are good at selecting the appropriate data sources to monitor. 
Depending on the precise type of pattern to be detected, different data 
sources are most appropriate. Satellite data, for example, are most useful 
for tracking cloud movement, while mesonet wind data can be used to signal 
imminent convection. 

4.2 Algorithms 

Processing algorithms for automatic pattern recognition typically are split 
into the following stages: 

• LOCAL 

First raw data are analyzed (e.g., the pixel level) to identify 
features or calculate additional variables; for example, IR brightness 
can be used to calculate cloud-top temperature and height. 

• REGION 


Next, pixel-level results are used to group pixels into identifiable 
regions; to continue the IR example, contiguous pixels indicating a 
temperature below a certain threshold might be lumped together into a 
single region. 

• OBJECT 

Finally, region-level results are analyzed structurally to associate 
particular regions with particular objects of interest to the human; 
to complete the IR example, the region of low temperature might be 
identified as the center of a small thunderstorm cell. 
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There are a variety of techniques which may be applied to each of tne various 
processing levels. These techniques are too detailed to discuss here, but are 
summarized in Appendix A. Also included are several observations concerning 
vihat we believe are the most important types of pattern recognition for 
summertime nowcasting in the Cape area. 

Objective techniques for automatic pattern recognition, however, are not 
well-developed. The algorithms which do exist are difficult to calibrate 
are verv computation-intensive. Their development typically requires access 
to long' meteorological records. These and other difficulties quicxly 
convinced us that automatic pattern recognition was not feasible for tne fxrst 
version of the WFES. On the other hand, it was absolutely clear t at ne « - 
design must allow for the inclusion of such algorithms in the future, should 
they become available. 

4.3 Forecaster Expertise 

The loose valuable expertise of weather forecasters lies principally at tne 
obiect level* To continue the example above, a minimal amount of Knowledge is 
required to recognize existing tnunderstorms from IR imagery. It is muen more 
difficult, however, to forecast the evolution of individual cells once they 
have been identified, and to extrapolate from the behavior of existing cells 
to that of cells which have not yet formed. 

We believe that the ability to interpret and extrapolate, which lies at a 
higher level of abstraction, is a key aspect of forecasting expertise and 
should be the focus of the initial WFES development. We believe this to be 
true for a number of reasons: 

, Automatic pattern recognition algorithms are time-consuming and costly 
to develop; 

• Object-level reasoning is more difficult to learn and is therefore 
most easily lost through forecaster attrition; 

• The evolving logic of the WFES prototype can be used to pinpoint where 
pattern recognition algorithms should be developed in the future. 
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5. nATA SYSTEMS AND TOOLS 


5.1 CCFF Systems 

The CCFF is as well-equipped for nowcasting as any facility in the world. lt 
is especially well-equipped for short-range thunderstorm forecasting. There 
is an extensive set of data available to CCFF forecasters, ranging from 
conventional radar to sophisticated local networks which measure atmospheric 
electricity, wind and temperature. 

The most pressing problem at CCFF is that forecasters do not yet have the 
required expertise for accessing and interpreting all of the data which is 
available to them. It would be a grave mistake to underestimate the 
difficulty of developing this expertise: 


• Many of CCFF ' s data sources are still experimental; 

• There are very few people anywhere who are expert at interpreting much 
of the data which exists at CCFF, particularly in an operational 

setting; 

• There are even fewer people who are expert in the operational use of 
all of CCFF data sources. 


New forecasters at CCFF have an enormous amount to learn concerning the 
effective use of CCFF's data systems and tools, and there is little 
operational experience to guide them other than the experience which has been 
gained at CCFF itself. 

The recent installation of Mcldas workstations at CCFF will alleviate the 
situation somewhat by bringing all data sources into a single location, but 
serious difficulties will remain: 


• Mcldas does not allow the forecaster to maintain a simultaneous view 
of synoptic-scale, mesoscale and microscale conditions; 

• The ability to overlay multiple data types onto a single map, one of 
the more powerful aspects of the Mcldas system, does not solve the 
problem of there being little operational experience in interpreting 
such overlays; 

• Exotic, unfamiliar data sources (such as Doppler and water vapor 
imagery) still will be exotic and unfamiliar. We believe that an 
Al-based system can serve as a powerful tool which will allow 
forecasters to capture their experience in using CCFF's data sources, 
and make that experience available to the entire forecasting staff. 
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5.2 WFES Workstation Technology 

The existence of the Mcldas system will be a great help in constructing an 

system for use « «F. « “^^r, IMS. ».‘S. 

most°ippi"priete workstation'techndogy for use by the «S. prefers, a 
brief analysis was made of alternatives. 

F °r aU riSXSoW the Environmental^Researc ^Laboratory (fpl) in 

Boulder 6 dorado a particular, ERL is currently developing the PROFS 
Operational Workstation (POWS), designed for stand-alone use, which 
ultimately be a direct competitor to the Mcldas system. 

From a technical standpoint, POMS is far .“ r % at ^ tlV ^” "f^tanda rd 
especially for purposes of of doc^entltion and 

support 6 are the "a” ’reasons for preferring it over Mcldas. From a practical 
standpoint, however, POWS is not a viable option as a replacement for the 
existing Mcldas system; 

• POWS will not be available for general use until 1987 at the earliest; 

• The extra cost of installing a POWS at CCFF would be at least $500K. 

Thus Mcldas is the preferred option for the WFES in the near term, although 
not necessarily in the long-term. 

in any event, the proposed design of the WFES would make it easy to integrate 
Jith a POWS at a later date, should that be desired by NASA. 


5.3 WFES Hardware and Software 

A number of hardware and software options were examined for development of the 
initial WFES prototype. Hardware options include . 


• IBM mainframe (i.e., MIDDS host); 

• personal computer; 

• Lisp-based workstation. 


Due to the lack of appropriate software for large-scale AI development, the 
f irs t two altematives f were b ,uickly a re ^^KS^r A^^r^r^tUe , 
Inc^use^Symbolics^bOO' s almost exclusively for their AI -related work. 
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The choice of software was considerably more difficult. Any Al-based S J Stem 
of the complexity envisioned for the WFES will require a sizeable software 

r f nr its development, and many commercial packages are available. 

sr™« ‘Sni *«!i: Vf u ; ct r £ i«r a n 1 ::r t t i" 8 the 

Vjfes does not closely correspond to any of tnose offered as a part 

commercially-available packages . 

The lack of similarity between the WFES architecture and those available 
commercially suggested that it might he best to develop a special-purpose 
. environmentLtrictly for building the WFES. We have deve oped sue 
soecia 1- pur pose environments in the past, and have found that doing so is 
sometimes an attractive option. A WFES-specif ic environment would nave 
number of advantages, particularly flexibility and speed of execution. 

However^ building such a special-purpose tool would be time-consuming and 

expens ive . 

After examining the alternatives, it was decided to use the ART software from 
Inference Corporation. This decision was based principally on the f 

availability of a robust "viewpoint" mechanism in ART, useful because o. 
extrapolative and speculative nature of short-range weather forecasting 
Furthermore, NASA already possesses several ART licenses, thereby reduc * 
development costs somewhat. 

More details concerning hardware and software options are included in 
Appendix 5 . 

A number of different schemes were analyzed for interfering the WFES to the 
He Idas system. For the initial version of the WFES prototype, it was decided 
that data transfer between the WFES and Mdldas should be performed by offline 
ransfer o data (via magnetic tape). Ultimately, the WFES must have a line 
to the Me Idas system wnich allows real-time transfer of large volumes of data, 
including satellite and radar images. The range of available interfacing 
options is illustrated in Appendix 0. 
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6. PROTOTYPE WEATHER FORECASTING EXPERT SYSTEM 


6,1 Option Evaluation 

During the course of the project, various options were identified as potential 
candidates for the WFES' functionality. These options addressed a wide range 
of perceived needs at CCFF, and largely corresponded to particular tasks 
regularly performed at CCFF. They are summarized below: 

• aucomated forecaster worksneet; 

• assistance with issuing met watches and advisories; 

• equipment-specific advice: 

pattern identification; 
pattern interpretation; 

• alarm monitoring for key weather parameters; 

• advice concerning KSC-specific STS operational requirements; 

• a scenario-based system for monitoring weather developments: 

predefined, rigid scenarios; 

- self-modifying, flexible scenarios; 

• interpretation of output from numerical models. 

A detailed discussion of these options may be found in Appendix 6. 

Each option was evaluated against the following criteria. 

1) direct operational benefits to NASA; 

2) general level of expertise involved; 

3) amount of Cape-specific experience required; 

4) degree to which Al technology is necessary; 

5) level of effort required for implementation. 

Criterion 1 is obvious. Criteria 2 and 3 address KSC 1 s most critical 
forecasting-related problem, namely the continual loss of hard-earned 
expertise at CCFF through forecaster turnover. The fourth criterion reflects 
our general experience that if a particular problem can be solved using 
conventional techniques, it is probably wiser and cheaper to do so rather than 
to use Al. Moreover, the stated goal of this project was to find a good 
application for Al technology. Finally, an application was required which did 
not require an unrealistic amount of effort for its implementation. 

Appendix 6 contains an extensive treatment of the evaluation of each option. 

The option chosen was to build a scenario-based system using predefined 
scenarios. The architecture corresponding to this choice is briefly descnoea 
in the following section. 
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6.2 System Design 


The primary function of the WFES will be to assist forecasters in anticipating 
significant weather events relating to summertime thunderstorm formation. As 
a part of this assistance, the WFES will allow forecasters to store their 
knowledge concerning particular weather scenarios, and re-examine that 
knowledge at a later date. In addition, the WFES should improve communication 
between forecasters by providing a common facility which allows them to 
describe the evolution of weather events while they are on duty. Finally, the 
WFES should assist the forecasters in maintaining a continuous train o. 
thought, despite the numerous interruptions which are a part of every 
forecaster's job. 


It is important to note that the WFES architecture corresponds as closely as 
possible to our understanding of the best experts' actual forecasting 
process. That is, each WFES module has its parallel in what we observed being 
done by expert forecasters. This architecture provides an extraordinary 
degree of flexibility in the WFES implementation, because it allows a large 
number of options for dividing the effort between human and machine. It also 
means that not all modules have to be completed to the same level of detail, 
because the function performed by any specific module could just as naturally 
be performed by the human. 


The system design required is rather complex, but is made up of simple 
building blocks. Before examining the flow of data within the WFlS 
architecture, it is most important to discuss the principle data structures 


• VARIABLE: a scalar or vector quantity associated with a single 
meteorological parameter; 

• FEATURE: an individual weather entity, usually associated with a 
relatively small set of VARIABLES; 

• EVENT: a qualitative change in a FEATURE, or by extension, a set o* 
FEATURES; 

• SCENARIO: a sequence of EVENTS which corresponds to an identifiable 
type of weather behavior. 

A simple example is offered to demonstrate the concept of how these data 
structures would be used. Assume that a scenario associated with morning 
showers being blown onshore from the Gulf Stream is being entertained. An 
event associated with such a scenario might be that light prevailing 
easterlies should develop during the late evening. The featur e to be 
examined, then, would be the local steering-level wind as measured at 00Z . 
Finally, the variable associated with the 00Z steering-level wind would be the 
700 mb wind at Tampa or West Palm Beach. 
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A complex scenario is illustrated in Appendix 6. It shows how tne scenario 
mechanism can be used to represent an interconnected set of events throughout 
a single day, events which ultimately lead to severe weather in the Cape 
area. The diagram showing this scenario is only a schematic, but it does 
indicate how small scenarios can be combined to form a coherent story tor tne 
entire day. (Note: this "scenario" actually corresponds roughly to what is 
referred to in the architectural diagrams as Today; see below.) 

The flow of data within tne WFES architecture wiil be described briefly. A 
top-level view is provided in Appendix 6 which snows the primary functions o. 
DETECT, MONITOR and ANTICIPATE. Each of these functions accesses data whi.cn 
is either external to the program (for example, "World" and "Knowledge' ) or 
internal (for example, "Expectations" and "Today"). Summary descriptions ot 
the three primary functions are given below: 

• DETECT: using expectations of future conditions, selectively process 
incoming data to confirm or deny those expectations, and update the 
system's most current description of how today has evolved so far; 

• MONITOR: compare current expectations witn how conditions are 
actually evolving, and update the status of actively - monitored 
scenarios ; 

• ANTICIPATE: using the current status of actively-monitored scenarios, 
look ahead to see what the future development of those scenarios 
implies about upcoming conditions, and modify future expectations 
accord ingly . 

Summary descriptions of the major data blocks include: 

• World: all meteorological data, taken from whatever source; 

• Today: the system's current symbolic description of how today has 
evolved up to the present; 

• Knowledge: the definitions of all predefined scenarios, with their 
associated events and heuristics; 

• Alternate Scenarios: the list of scenarios that are currently being 
monitored actively; 

• Expectations: the next set of future events implied by the Alternate 
Scenarios . 


Even without more detail, we hope the reader can now understand tne 
architectural diagrams in Appendix 6. In addition to the top-level view of 
the WTES structure, there also are detailed diagrams snowing tne next level of 
detail of DETECT and MONITOR. Appendix 6 also contains diagrams whicn 
illustrate now data from one set of measurements, the local sxew-T, woula oe 
processed within tne WFES arch itecture . Ihese diagrams are particularly 
informative because they give a concrete example for each of tne tunctions ana 
the data associated with the detailed WFES architecture. 
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6.3 Development Approach 


u . J UC V ^ «■* "ri 

The proposed approach to developing the WFES prototype is a simple one, and 
has two main features: 

• early creation of a usable interface j 

• careful attention to the order of module development. 

T t has been our experience that the development of an AI system proceeds much 
more smoothlv when there is a robust user interface suitable for use by tne 
exDerts. In' the case of the WFES, an editing facility for defining and 

?. f , ’ crenarios and a crude mechanism for examining how those scenarios 
:fn op” 8 rat e !“ni L bui!c first. By providing tools for the experts to use 
as early as possible, ve anticipate getting valuable feedback concerning hoc 
tL UFES should interact with the forecaster, as veil as suggestions as to hoc 
tS 7AI logic should operate. In addition, by working closely with us as the 
prototype evolves , the Experts will become an Integral part of the project 

team. 

The order of module development is critical. Those modules which are 

c c a rv for the WFES to be a useful tool will be developed first. The 
modules ^hich are part of the overall system design, but whose functions could 
be performed by the human, will be developed next. 

The specifics of how each module fits into the overall development approach 
are presented in Appendix 6. At the same time, the various sources of 
information for the WFES prototype have been indicated, and the bas c ro es 
Pacified for each group that will provide that information. The primary 
source of weather-related expertise will be the two experts in thunderstorm 
forecasting , J. Nicholson of Lockheed and J. Smedley of Low Latitude Dynamics. 


for 


6. A Prototype Options 

Two basic options for the WFES prototype were presented to NASA management 
evaluation, ^differing in scope and level of effort, though both involve a 
two-vear program. Option 1 describes a WFES directly linked to the MIDD 
system early m the project, which concentrates on providing advice concerning 
all thunderstorm formation activities which could affect the Cape area. 

Option 2 is considerably reduced in its goals. It relies upon off-line 
transfer of data from the MIDDS system to the WFES, and concentrates onl> on 
those thunderstorms which form in the immediate Cape area. 

The difference in scope between these two options is reflected in the 
difference in price: the first option has an estimated development cost of 
around $1.2 million, while the second is estimated to cost around $550 
thousand. Because of budgetary limitations, KSC management chose the second 

opt ion . 

To avoid unnecessary repitition, Option 1 will be described first, then the 
required modifications will be discussed thac led to Option 2. 
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6.4.1 Option 1: High Effort 


Under this plan, during the first year the focus of efforts was to^be on 
building a structure for the weather scenarios, and the logic (or inference 
engine") required to process those scenarios. Considerable time was to be 
spent on-site at CCFF working closely with both the domain experts and CCFF 
staff. The main goal of the first year was to gain sufficient information to 
assess the requirements for implementing a fully-operational WFES at CCFF. 
Obtaining this information would require: 

• a detailed knowledge of thunderstorm formation in the Cape area as 
well as a clear awareness of how forecasters respond to those storms 

• a set of software which closely matches that knowledge, including. 

- a robust facility for defining and e editing weather scenarios; 

- a set of logic for identifying and monitoring "interesting" weathe 
features ; 

- a graphical, interactive interface to the MIDDS system. 

During the second year, the plan called for a three-month operational testing 
of the WFES prototype at CCFF during the thunderstorm season. This required 
implementing the details of what had been learned during the first year, and 
included : 

• an advanced user interface suitable for unsupervised use; 

• an environment for browsing through, and modifying, the knowledge 
base of scenarios; 

• sophisticated logic for automatic generation and monitoring of 
significant thunderstorm scenarios; 

• automatic, high bandwidth linkage of the WFES to previously-stored 
MIDDS case histories. 

A task diagram in Appendix 6 summarizes the proposed schedule for this first 
option, and includes approximate costs for completion of each task. As 
mentioned, the total cost for this option was estimated to be $1.2 million. 

6.4.2 Option 2: Medium Effort 

Under the second option, major tradeoffs were made between the WFES 
functionality and the benefits to be gained by KSC from developing the 
prototype. The basic aim was to reduce the cost as much as possible without 
sacrificing the original goal of the WFES prototype: to capture valuable 
forecasting expertise, specifically relating to Cape-specific nowcasting, in 
a set of AI-based software. 
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We firmly believe that, even given the reduced level of effort, Option 2 will 
provide NASA management with the information they require concerning the cost 
and overall advisability of implementing an operational WFES during the next 
several years. 

To that end, Option 1 was modified in a number of ways. The major 
modifications were as follows: 

• the knowledge base of weather scenarios will be limited to those 
thunderstorms which form in situ over the Cape; 

• data transfer from MIDDS to the WFES will be considerably simplified 
by using magnetic tape and a low-speed serial link; 

• no operational testing will be performed at CCFF , and the role of 
CCFF staff will be advisory rather than one of direct involvement . 

Due to the preliminary nature of the WFES prototype and the lack of 
operational testing, it was also decided that user documentation would be 
limited to that required by the developers and a few trained users. 

Similarly, it was decided that the WFES user interface, though usable, will 
not be sufficiently robust to support unsupervised use. 

Appendix 6 includes a summary chart showing the proposed task breakdown and 
timing for Option 2, as well as the estimated cost. It represents a two-year 
effort at a cost of approximately $550 thousand. 
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CONCLUSIONS 


• GROUND OPERATIONS ALL AFFECTED MORE BY INACCURATE FORECASTS 
THAN STS LAUNCH AND LAND OPERATIONS 


• Thunderstorms are the major forecasting problem 


• Forecaster experience on-station at CCFF is a major 

DETERMINANT OF FORECASTING SKILL 


• STAFF TURNOVER RATE IS HIGH AT CCFF 


• The PROTOTYPE WFES SHOULD FOCUS ON CAPTURING FORECASTER 
EXPERTISE IN PREDICTING SUMMERTIME THUNDERSTORMS 


• The MAJOR BENEFIT WOULD BE IMPROVED FORECASTING SUPPORT OF 
DAY-TO-DAY OPERATIONAL ACTIVITIES 
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KEY FINDINGS 


• Forecaster expertise lies largely in knowledge of 

WEATHER SCENARIOS 

t SUMMERTIME THUNDERSTORM FORECASTING REPRESENTS THE 
PREFERRED INITIAL TOPIC FOR WFES 

• The AI-architecture required to capture and use weather 

SCENARIOS IS COMPLEX 

• Though complex, the required AI technology is feasible 

AND IN CURRENT USE 

• The PROPOSED DEVELOPMENT effort is MODULAR, FLEXIBLE and 
PRESENTS A CLEAR MIGRATION PATH TO A FULLY-OPERATIONAL 

WFES 
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PliRPOSF OF MEETING ON O CTOBER 21. IbSS 


TO RESPOND TO COMMENTS FROM ATTENDEES OF SEPTEMBER S. lbb5 
MEETING AND TO FILL IN DETAILS BEHIND RECOMMENDATIONS. 

1. CIRCUMSTANCES AT KSC 

2. Key findings 

3. RATIONALE FOR PROPOSED WFES PROTOTYPE 

- POTENTIAL WFES FUNCTION 

- POTENTIAL WEATHER SUBJECTS 

4. Expand on AI-specific technology 

- Pattern recognition 

- knowledge representation scheme 

- Architecture and modules 

5. REDUCED SCOPE OF DEVELOPMENT PLAN 
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CIRCUMSTANCES AT NAS A . K S£ 


• WEATHER FORECASTING IS CRITICAL TO STS OPERATIONS 

• KSC HAS A UNIQUE CLIMATOLOGY 

• Forecasting expertise is built-up with experience at KSC 

• personnel changes occur frequently 

• Problem 1: accumulation of forecasting expertise is 

jeopardized 

• Problem 2 : Forecasters must handle increasingly greater 

AMOUNTS OF INFORMATION 

• These problems will become significantly worse as STS 

LAUNCH FREQUENCY INCREASES 
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NASA KSC IS AN IDEAL ENVIRONMENT FOR DEVELOPING A WEATHER 
FORECASTING EXPERT SYSTEM: 

• Weather has a major impact on STS operations 

• unique data systems are available 

t A DEDICATED STAFF IS RESIDENT 

• Forecasting experts are available 

• Short-range forecasting is an art, not a science 
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APPENDIX 1 
TASK 1 


WEATHER DEPENDENT STS PROCESSING FUNCTIONS 


The CCFF PROVIDES METEOROLOGICAL SUPPORT FOR: 


BTB OPERATIONS: ROLLOUT, LAUNCH & LAND 

KSo/CCaF ground operations 

range safety.- spill footprints, sound propagation 

RECOVERY FORCES: AIRCRAFT AND SHIPS 

ESMC OPERATIONS 

AEROSTAT 

NAVY: REDSTONE, CRANE 

Patrick AFB Brd shift 

BOMBING RANGE 
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STS WEATHER REQUIREMENTS 


Launch Site: 

S3 F<TEMP.<99 F 

NO PRECIPITATION: EXTERNAL TANK LOADING THROUGH 
LAUNCH 

ICE<1/16 INCH ON EXTERNAL TANK 
SURFACE WINDS PRE-LAUNCH : < 49 KNOTS STEADY 
SURFACE WINDS AT LAUNCH: <3M.H KNOTS PEAK 

<22.6 KNOTS STEADY 
UPPER AIR: WIND SHEARS WITHIN VLL 

ELECTRIC FIELD CONTOURS: <1000 V/M 

Landing Site: 

NO PRECIPITATION (RTLS) WITHIN 50 NM (EOM) 
SURFACE WIND COMPONENTS: < 25 KNOT HEADWIND 

<10 KNOT CROSSWIND 
<10 KNOT TAILWIND 
TURBULANCE: MODERATE OR LESS 

VISIBILITY: > 7 NM 


Flight Path: 

>i NM EDGE OF THUNDERSTORM RADAR CELL OR 
EDGE OF ASSOCIATED ANVIL 
>5 NM FROM CELL WITH TOP REACHING TO -20 C 
OR CUMULUS CLOUDS MUST HAVE RADAR ECHOES & 
TOPS BELOW -10 0 
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LC-39 AREA WIND RESTRICTIONS 


>» 10 KNOTS: NO SPIDER WORK ALLOWED 

BETWEEN ET AND ORBITER 

> IS KNOTS: CEASE HAMMERHEAD AND MOBILE CRANE 

LIFTING OPERATIONS 

20 KNOTS: NO PERSONNEL WORKING ON FLOATS, 

~~ SPIDERS OR SCAFFOLDING 

> 3Q KNOTS: EVACUATE THOSE SECTIONS OF VEHICLE 

INTERIOR WHERE SAFE EGRESS DEPENDS 
ON ORBITER ACCESS ENVIRONMENTAL CHAMBER 

> MS KNOTS: SWITCH LH^ LC^ LOAD TO DRAIN AND 

RETRACT GOX VENT ARM 
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LC-30 AREA LIGHTNING RESTRICTIONS 


NO LIGHTNING WITHIN S HUES 
WEATHER ADVISORIES SO H1N BEFORE IF POSSIBLE 
UPON CONFIRMED STRIKE, ANNOUNCE LIGHTNING PROTECTION 
POLICY IN EFFECT 

WHEN STORM HAS PASSED AT LEAST 5 MILES FROM AREA, 
ANNOUNCE THREAT NO LONGER EXISTS 
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SAFETY OPERATING PROCEDURES 


OF 65 TOPICS IN TABLE OF CONTENTS: 

52 REQUIRE WARNINGS OF STORMS WITH LIGHTNING 
16 HAVE ADDITIONAL METEOROLOGICAL CONSTRAINTS 
ONLY 4 REQUIRE BY POLICY SPECIFIC FORECAST 
OR WEATHER SUPPORT 


A HOST OF OTHER GROUND OPERATIONS ARE WEATHER SENSITIVE 
SPRAY PAINTING: WINDS 17 KNOTS 

ELECTRICAL WORK: STORM WARNING HALTED WORK AT 

2:00 P.M. BECAUSE THEY DIDN’T KNOW WHAT WAS 
COMING, KNOCKED OFF SHIFT EARLY AND LOST WHOLE 
DAY . 
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"It's the day-to-day delays that cause 

THE MOST PROBLEMS .. .LITTLE THINGS..." 

BOB SlECK, POINTING AT 

JFKSC Integrated Control Schedule 


"Our major forecast problem is ThE 

SUMMER THUNDERSTORM SITUATION." 

MET MODERNIZATION PLAN, 198M 
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APPENDIX 2 
TASK 2 

KEY WEATHER SCENARIOS AT NASA KSC 


i 
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critical weather phenomena 


LIGHTNING, WIND AND PRECIPITATION ARE THE bIGGEST 
PROBLEMS 


Fog only occasionally affects NASA operations 


LIGHTNING PROTECTION IS ELABORATE AND EFFECTIVE TO THE 
EXTENT POSSIBLE 


The IMPORTANCE OF LIGHTNING IS SHOWN BY THE PRESENCE OF 
A NASA EXPERT AT CCFF DURING LL 


WIND IS PARTICULARLY A SAFETY PROBLEM FOR INDIVIDUALS 

ON 

TOWERS AND HANDLING PROPELLANTS 

WIND ALSO PRESENTS PROBLEMS FOR SENSITIVE STS PAYLOADS 
BECAUSE OF DUST 




Precipitation causes problems 

MOVEMENT, PAINTING, ETC. 


FOR THE TILES, CARGO 
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IMPORTANT WEATHER SCENARIOS 


I The most IMPORTANT SCENARIOS BY SEASON: 
CONVECTIVE ACTIVITY IN SUMMER 
FOG & LOW VISIBILITY IN TRANSITIONS 
FRONTAL APPROACH & STAGNATION IN WINTER 


• Fog AND LOW VISIBILITY NOT MOST IMPORTANT OPERATIONALLY 


• FRONTAL SYSTEMS OFTEN HAVE IMBEDDED THUNDERSTORMS 


• SUMMER THUNDERSTORM FORMATION: 

PRIMARILY FORCED BY MESOSCALE EFFECTS 
VARIES ON A DAILY CYCLE 


• Major patterns of thunderstorm formation can feasibly 

BE PUT INTO A TAXONOMY OF SCENARIOS 
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POTENTIAL WFES WEATHER SUbJEGTS 


S IMP LE 

• Precipitation 

- SUMMER SHOWERS 

- FRONTAL 

t LIGHTNING 
t WINDS 

- GENERAL (DAILY CONSTRAINTS) 

- LAUNCH AND LANDING 

• Fog and Stratus 


COMPLEX 

• Frontal Activity 

- MOVEMENT AND DISSIPATION 

- IMBEDDED SOUALL LINES 

i Thunderstorms 

- FORMATION OVER CAPE 

- ADVECTION OF EXISTING CELLS 

- END-OF-STORM 


?-L 
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POTENTIAL WFES SUBJECTSj QUESTIONS. 


• is IT A SERIOUS OPERATIONAL PROBLEM? 

• DOES SIGNIFICANT EXPERTISE EXIST? 
t DOES IT OCCUR FREQUENTLY? 

• ARE UFF-SPECIFIC DATA SOURCES REQUIRED? 

• IS LOCAL EXPERIENCE NECESSARY TO FORECAST ACCURATELY? 

• IS THE PROBLEM WE L L -BOUNDED? 
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PRECIPITATION 


FOk : 

t OCCURS FREQUENTLY 

Against: 

t EASY TO DETECT AND MONITOR 

• DIFFICULT TO SEPARATE FROM OTHER SCENARIOS 

• LOCAL EXPERTISE NOT IN PRECIPITATION PER . .£& 

• UNIQUE CCFF DATA SOURCES NOT DIRECTLY REQUIRED 
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LIGHTNING 


FOR: 

t An extremely serious operational concern 

• OCCURS FREQUENTLY 

• LOCAL EXPERTISE IS EXTENSIVE 

• LIGHTNING-SPECIFIC EQUIPMENT IS UNFAMILIAR TO NEW 
FORECASTERS 

Against; 

• East to detect and monitor 

• Difficult to separate from other scenarios 

• not well-understood physically 
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For: 

• A SERIOUS OPERATIONAL CONCERN 

• SPECIAL KNOWLEDGE REQUIRED TO INFER WINDS INDIRECTLY 

• WIND-SPECIFIC EQUIPMENT AT CCFF UNFAMILIAR TO NEW 
FORECASTERS 

AGAINST: 

• RELATIVELY INFREQUENT 

• DIFFICULT TO SEPARATE FROM OTHER SCENARIOS 

• Very difficult to forecast: expertise is spotty 
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FOG AMD STRATUS 


FOR: 

• A WELL-BOUNDED PROBLEM 

t Objective techniques exist 

• LOCAL GEOGRAPHY HAS A LARGE INFLUENCE 

Against: 

• NOT A SERIOUS OPERATIONAL CONCERN (TO NASA) 

• A VERY SUBTLE FORECASTING PROBLEM 

• RELATIVELY INFREQUENT 

• Expertise is not strong in this area 
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FRONTAL ACTIVITY: MOVEMENT. DISSIPATION 


For: 

§ Frontal behavior in Florida is unique 

• Local experience is needed for accurate forecasting 

• Associated with operational concerns 

Against; 

• Largely a synoptic-scale problem 

• REQUIRES interpretation of model results 

• NOT year-round 

• COMPLEX 
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FRONTAL ACTIVITY i SQUALL LINES 


Other than a general lack of a diurnal cycle, comments on 
"Thunderstorms: advectiqn" apply here. 
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T^IINhFRSTQRMS : FORMATION OVE R £AE£ 


Em 

• A WELL-BOUNDED PROBLEM 

• CCFF'S UNIQUE DATA SOURCES ARE ESSENTIAL 

• LOCAL EXPERIENCE REQUIRED FOR ACCURATE FORECASTING 

t Expertise is available 

AGAINST:. 

• RELATIVELY INFREQUENT 
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THUNDERSTORMS; ADVECTION 


For: 

• CCFF'S UNIQUE DATA SOURCES ARE ESSENTIAL 

• Occur frequently 

• A VERY SERIOUS OPERATIONAL PROBLEM 

• Expertise is available 

t Local experience required for accurate forecasting 
t diurnal cycle given a structure to problem-solving 

(SUMMER) 

Against? 

• Difficult to define boundaries of problem 

• Complex 
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THUNDERSTORMS; END-QF -STORM 


EGJLl 

t The most sekious operational problem 

• OCFF'S UNIQUE DATA SOURCES ARE ESSENTIAL 

t Occur frequently 

t LOCAL EXPERIENCE REQUIRED FOR ACCURATE FORECASTING 
AGAINST; 

• Difficult to define boundaries of problem 

• Extremely complex 

• Very difficult forecasting problem 

• expertise not well-developed 
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RATIONALE FOR SELECTING THUNDERSTORM PROBLEM 


• Lightning, wind and rain have greatest impact on operations. 

• Thunderstorms contain all three. 

• Thunderstorms form rapidly and require constant alertness. 

• Forecast training and experience stresses mid-latitude 

forecasting techniques. 

• Thunderstorm forecasting is largely based on personal 

EXPERIENCE . 

• Two OR THREE SEASONS OF EXPERIENCE ARE REQUIRED TO ENCOUNTER 

A SUFFICIENT NUMBER OF THUNDERSTORM SCENARIOS. 

• Thunderstorm forecasting is complex and requires forecasters 

TO ASSIMILATE ALMOST ALL OF CCFF'S DATA SOURCES. 

• Many of CCFF's data sources are unfamiliar to incoming 

FORECASTERS . 

• CONSIDERABLE EXPERIENCE IS REQUIRED BEFORE PROFICIENCY IS 

REACHED IN USING CCFF'S DATA SOURCES. 
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TASK 3: FORECASTING METHODS 

OVERVIEW 


FORECASTING METHODS AT CCFF DIFFER DRASTICALLY FROM SEASON TO 

season. For the purposes of Building a WFES. the primary 

DIFFERENCE IS THE DEGREE TO WHICH MID-LATITUDE FORECASTING 

TECHNIQUES ARE EFFECTIVE. IN GENERAL: 

• WINTER FORECASTING PRESENTS PROBLEMS FOR WHICH AIR FORCE 
TRAINING AND EXPERIENCE ARE WELL-SUITED. SYNOPTIC-SCALE 
EFFECTS PREDOMINATE. AND GUIDANCE PRODUCTS ARE QUITE 
USEFUL . 

• SUMMER CONDITIONS ARE TROPICAL. MESOSCALE EFFECTS 
DOMINATE, AND SYNOPTIC CONDITIONS BECOME A 
SLOWLY-VARYING BACKGROUND AGAINST WHICH MESOSCALE EVENTS 
OCCUR. Few guidance PRODUCTS ARE USEFUL. AND FORECASTER 
EXPERIENCE WITH LOCAL WEATHER PATTERNS IS NECESSARY. 
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TASK 3: FORECASTING METHODS 

OVERVIEW (CONTINUED) 


Forecasting techniques change as the information available to 

THE FORECASTER CHANGES. THIS AFFECTS THE WFES IN TWO WAYS: 

t NEW PERSONNEL ARE FACED WITH A WIDE VARIETY OF TOOLS 
AND DATA SOURCES AT CCFF WHICH ARE ALMOST TOTALLY 
UNFAMILIAR. 

• EXISTING PERSONNEL MUST ADAPT TO CCFF'S 

RAPIDLY-CHANGING ENVIRONMENT AS NEW TOOLS AND DATA 
SOURCES BECOME AVAILABLE. 

SINCE NEW FORECASTERS MUST BE PRODUCTIVE ALMOST IMMEDIATELY, 

THE WFES SHOULD PROVIDE OPERATIONAL ASSISTANCE RATHER THAN 
OFF-LINE TRAINING. 

SINCE THE CCFF ENVIRONMENT IS DYNAMIC. THE WFES MUST BE 
SUFFICIENTLY FLEXIBLE TO ALLOW FOR CHANGES IN FORECASTING LOGIC 

AND PROCEDURE. 
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FORECASTING ENVIRONMENT 


• The duty forecasters provide day-to-day continuity. 

• The most skilled forecasters are present during 

LAUNCH AND LAND. 

• Personnel most knowledgeable about NASA operations 

ARE GUARANTEED PRESENT DURING LAUNCH b LAND. 

• DUTY FORECASTERS PRIMARY CONTACT WITH NASA IS VIA 

KSC DUTY OFFICER. 

• Numerous special requirements must be satisfied 

ON A DAILY BASIS. 

t CONSTANT INTERRUPTIONS OFTEN PREVENT COMPLETE ANALYSIS 

OF WEATHER DATA. 

• Frequently data are missing or unavailable. 


/L Arthur D. Little, Inc. 


3-i 



BIGGEST PROBLEM 


NASA : "AF STAFF TURNOVER BIGGEST PROBLEM." 

Staff Met: "Experience on station is 50X of ability 

TO FORECAST." 

Duty Forecaster: "Hardest part of job? Too many 

DISTRACTIONS." 


OTHER PROBLEMS 


Each customer has different requirements. 

OF: "Hard to remember who needs what..." 

Forecaster vocabulary different from customers. 

DF: "Have to translate into everyday language." 

reporting formats vary by customer. 
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TASK 3: FORECASTING METHODS 

SUMMER FORECASTING 

In THE SUMMER, SHORT-RANGE FORECASTING IS CHARACTERIZED BY ThE 
FOLLOWING METHODS: 

t CLIMATOLOGY 

• Product evaluation 

t Detection and Monitoring of Mesoscale Features 

• analogical reasoning 
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TASK 3: FORECASTING METHODS 

CLIMATOLOGY 


In general, climatology does not provide an alternate 

PREDICTION, BUT RATHER SERVES AS BOTH A STARTING POINT FOR THE 
DAY AND A SET OF FORECASTING CONSTRAINTS. 

The use of local climatology may be divided into two broad 

AREAS: 

• Persistence 

Objectively, the best overall "technique" is simply to 

PREDICT THAT TODAY WILL BE LIKE YESTERDAY 

• STATISTICAL 

Statistical analyses available to CCFF forecasters 

INCLUDE: 

CONDITIONAL PROBABILITIES FOR SIMPLE PHENOMENA 
SUCH AS FOG 

REGRESSION EQUATIONS WHICH PREDICT SUCH THINGS AS 
SEA BREEZE ONSET AND LIKELIHOOD OF THUNDER 
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TASK 3: FORECASTING METHODS 

PRODUCT EVALUATION 


ALMOST ALL SYNOPTIC-SCALE GUIDANCE PRODUCTS ARE VIRTUALLY 
USELESS DURING THE SUMMERTIME. 


In fact, they may be worse than useless because they can 

MISLEAD AN INEXPERIENCED FORECASTER. 


MESOSCALE effects dominate, but accurate mesoscale models are 

NOT YET AVAILABLE. 


EVEN IF A MESOSCALE MODEL WAS INSTALLED TODAY, IT WOULD TAKE 
YEARS OF EXPERIENCE BEFORE IT COULD BE USED EFFECTIVELY 
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TASK 3: FORECASTING METHODS 

DETECTION AND MONITORING 


Most of a forecaster's available time and energy is devoted to 

DETECTING AND MONITORING INDIVIDUAL STORM COMPLEXES, WHEN THEY 
EXIST. 

This task is basically a reactive one, and few forecasters have 

SUFFICIENT EXPERTISE TO REASON ABOUT THE PHYSICS OF MESOSCALE 
EVOLUTION. 

Ironically, when there is significant storm activity near the 
CAPE: 

t FORECASTERS SHOULD DEVOTE ALL THEIR ENERGIES TO 

TRACKING CURRENT DEVELOPMENTS, ON A MINUTE _ BY~MINUTE 
BASIS. USING ALL OF THE DATA WHICH IS AVAILABLE i 

• IT IS AT THIS TIME THAT THEY ARE MOST CONSUMED WITH 
ANSWERING INCOMING TELEPHONE CALLS AND PERFORMING 
PAPERWORK (ASSOCIATED WITH ISSUING WATCHES AND 
WARNINGS) . 
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TASK 3: FORECASTING METHODS 

ANALOGICAL REASONING 


ANALOGICAL REASONING INVOLVES THE COMPARISON OF CURRENT EVENTS 
WITH SPECIFIC FORECASTER EXPERIENCES. IT INCLUDES THREE BASIC 
ACTIVITIES: 

• CLASSIFYING TODAY’S CONDITIONS BY IDENTIFYING THEM 
WITH ONE OR MORE DISCRETE SCENARIOSi 

• ANTICIPATING FUTURE EVENTS IMPLIED BY THOSE SCENARIOSi 

• VERIFYING THAT THE BEHAVIOR OF EACH SCENARIO 
CORRESPONDS, AT LEAST ROUGHLY, TO HOW TODAY'S WEATHER 
BEHAVES. 

IN THE SUMMER, SHORT-RANGE FORECASTING IS DOMINATED BY 
ANALOGICAL REASONING. THERE ARE SEVERAL REASONS FOR THIS: 

• Explicit modeling of mesoscale features is not yet 

RELIABLE. 

• Analogs provide a conceptual framework for recognizing 

AND INTERPRETING MESOSCALE PATTERNS. 

• Climatological analyses are unable to take into 

ACCOUNT THE PRESENCE OR ABSENCE OF THOSE MESOSCALE 
FEATURES WHICH DRIVE SUMMERTIME WEATHER PATTERNS OVER 

Florida. 
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TASK 3 FORECASTING METHODS 
ANALOGICAL REASONING (CONTINUED) 


WHATEVER THE PRECISE FORM OF A SPECIFIC FORECAST (MET WATCH, 
12-HOUR TERMINAL FORECAST, ETC.), IT IS ALMOST ALWAYS BASED 
UPON A RATHER DETAILED SCENARIO WHICH EXISTS ONLY IN THE MIND 
OF THE FORECASTER. 


There is some communication of these scenarios between 

FORECASTERS DURING A SHIFT CHANGE AND IN FORMAL DOCUMENTS, BUT 
IT IS RELATIVELY CURSORY AND INCOMPLETE. 


BETTER FORECASTERS MAINTAIN COMPETING SCENARIOS WHICH DESCRIBE 
THE GENERAL RANGE OF POSSIBLE OUTCOMES DURING THE NEXT SEVERAL 
HOURS. 
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APPENDIX 4 
TASK 4 

PATTERN RECOGNITION TECHNIQUES 
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TASK 4: PATTERN RECOGNITION 

OVERVIEW 


In its most general sense, the recognition of particular 

PATTERNS IS ThE FUNDAMENTAL TASK OF SUMMERTIME NOWCASTING AT 

CCFF . 


The following sorts OF FEATURES, AMONG OTHERS, ARE OF INTEREST: 

• SEA BREEZE ONSET: 

• CONVECTION ASSOCIATED WITH THE SEA BREEZE FRONT: 

• ARC CLOUDS SHOWING OUTFLOWS FROM EXISTING CELLS 

• CONFLUENT ZONES WHICH INDICATE POTENTIAL FOR FUTURE 
CONVECTION AND 

I # SEVERE-WEATHER SIGNATURES IN VERTICAL SOUNDINGS. 

I 

USING THE DATA SOURCES AVAILABLE AT CCFF, A WELL-TRAINED 
! FORECASTER IS EXTREMELY ADAPT AT RECOGNIZING SUCH PATTERNS. 
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TASK Ms PATTERN RECOGNITION 
DATA SOURCES FOR OBJECTIVE TECHNIQUES 

There are numerous possibilities for the use of objective, 

ANALYTICAL TECHNIQUES IN RECOGNIZING CERTAIN TYPES OF PATTERNS 
The USE OF SUCh TECHNIQUES depends on the DATA source involved 

• SATELLITE: CLOUD MOVEMENT 

• DOPPLER: CELL STRENGTH. STORM SEVERITY 

t VOLUMETRIC RADAR: STORM TRACKING, SEVERITY 

i MESONET: IMMINENT CONVECTOhS, SEA BREEZE ONSET 

t Field Mills: lightning warning (beginning and end) 
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TASK M: PATTERN RECOGNITION 

OBJECTIVE PATTERN-RECONGITION TECHNIQUES AND THE WFES 


Objective techniques for pattern recognition are not 

WELL-DEVELOPED . AND HAVE THE FOLLOWING CHARACTERISTICS: 

t THEY ARE DIFFICULT TO CALIBRATE AND REQUIRE A LARGE 
AMOUNT OF COMPUTATIONAL HORSEPOWER 

• FEW EXISTING TECHNIQUES ARE SUFFICIENTLY ACCURATE TO 
BE BLINDLY ACCEPTED BY FORECASTERS 

• THEIR FOCUS IS ON FEATURES WHICH HAVE A TIME SCALE OF 
THIRTY MINUTES OR LESS 

• THEIR DEVELOPMENT REQUIRES DETAILED METEOROLOGICAL 
EXPERTISE AND ACCESS TO LONG HISTORICAL RECORDS 

The INFORMATION REQUIRED FOR QUALITATIVE SCENARIO TRACKING 
CAN BE OBTAINED WITHOUT OBJECTIVE PATTERN RECOGNITION 
TECHNIQUES. 

The initial WFES will not include objective 

PATTERN-RECOGNITION TECHNIQUES. 

The WFES will be expandable to include objective 

PATTERN-RECOGNITION TECHNIQUES. 
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PATTERN RECuGNITIQUi OVERVIEW 


Processing algorithms are split into three levels: 


• LOCAL (GRID POINT OR PIXEL) 

• REGION (CONNECTED GROUPS OF GRID POINTS OR PIXELS) 

• OBJECT (SPECIFIC. CLASSIFIED REGIONS OR GROUPS OF 
REGIONS) 

TYPICALLY, PROCESSING IS DONE IN STAGES: 

• RAW DATA IS ANALYZED LOCALLY TO IDENTIFY FEATURES OR 
CALCULATE ADDITIONAL VARIABLES 

• PIXEL-LEVEL RESULTS ARE USED TO GROUP NEARBY PIXELS 
INTO IDENTIFIABLE REGIONS 

• REGION-LEVEL RESULTS ARE THEN ANALYZED STRUCTURALLY TO 
ASSOCIATE REGIONS WITH SPECIFIC TYPES OF OBJECTS AND 
ASSOCIATED LABELS 

IN THE WF ES , FORECASTER EXPERTISE IS MAINLY AT THE OBJECT LEVEL. 
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IQCAL ANALYSIS: OVERVIEW 


LOCAL ANALYSIS DIVIDES INTO TWO BASIC TYPES: 

• PHYSICALLY BASED 

• SIGNAL CLASSIFICATION 

PHYSICALLY BASED ANALYSIS OCCURS WHEN NEW VARIABLES ARE DERIVED 
LOCALLY USING "EXACT" EQUATIONS. FOR EXAMPLE. IR BRIGHTNESS 
RELATES DIRECTLY TO TEMPERATURE. WHICH RELATES DIRECTLY TO 

HEIGHT. 

SIGNAL CLASSIFICATION IS STATISTICAL AND DERIVES QUALITATIVE 
PROPERTIES FROM RAW DATA. FOR EXAMPLE, A COMBINATION OF 
VISIBLE AND IR IMAGERY MAY BE USED TO CLASSIFY CLOUD TYPES. 
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REGION ANALYSIS; OVE RVIEW 


REGION ANALYSIS MAY BE PERFORMED IN THREE WAYS: 

t SIMPLE CONNECTIVITY TO GROUP LIKE PIXELS INTO INDIVIDUAL 
REGIONS 

• EDGE DETECTION TO IDENTIFY BOUNDARIES 

t SPLIT-MERGE TECHNIQUES TO ELIMINATE SPURIOUS, ISOLATED 
PIXELS 

CONNECTIVITY IS STRAIGHTFORWARD THOUGH TEDIOUS. 

Edge detection is useful when the shape of a region is more 

IMPORTANT THAN THE CONTENTS. 

SPLIT-MERGE IS OFTEN USED AS A POST-PROCESSOR TO "SMOOTH" A 
FIELD PRIOR TO USING CONNECTIVITY OR EDGE DETECTION. 
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fl &JECT ANALYSIS: OVERVIEW 


Object analysis involves classifying regions into specific 

CLASSES WITH WHICH THE USE k IS FAMILIAR. 

EXAMPLES: OL ASSIFICATION OF CLOUD TYPES 

IDENTIFICATION OF GUST FRONTS 

OBJECT ANALYSIS IS: 

t Relatively easy when the objects correspond to single 

REGIONS (ISOLATED CELL, GUST FRONT) 

• Much more difficult when the "objects" are clusters of 

DISCONNECTED REGIONS (FRONTAL ZONE, THUNDERSTORM 
COMPLEXES) 
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PATTERN RECO GNITION ISSUES 


• DEPENDING ON ALGORITHM COMPLEXITY AND IMAGE SIZE, 
EXTREMELY LARGE AMOUNTS OF PROCESSING CAN BE REQUIRED 
FOR INTERACTIVE USE. 

• Classification can be difficult because of the large 

NUMBER OF POTENTIAL FEATURES FROM WHICH TO CHOOSEi ALSO. 
STATISTICAL DATA MUST BE AVAILABLE AND V E R I F I E J) . 

• MEASUREMENT NOISE MAY MAKE CLASSIFICATION DIFFICULT, 
ESPECIALLY WHEN USING RADAR IMAGERY. 

• FOR TRACKING PURPOSES, THE AMOUNT OF TIME BETWEEN 
SATELLITE IMAGES MAY BE TOO LONG. 
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PATTERN R£C^ NTT 10n TECHNIQUES 


Pixel CLASSIFIC ATION 

• Threshold testing 

• Statistical classification 

- BAYESIAN 

- PIECEWISE LINEAR 

- ARBITRARY NON-LINEAR 

NOTE: UNCOVERING THE MOST RELEVANT FEATURES IS USUALLY MORE 

DIFFICULT THAN BUILDING THE CLASSIFICATION SCHEME. 

FnfiE DETECTION 

• TEXTURE ANALYSIS 

• MODEL FITTING 
CONNECTIVI TY ANALYSIS 

• SPLIT-hERGE 

• DESCRIPTOR MATCHING (CLUSTERING) 

• LOW-LEVEL CORRELATION (E.G., EXTRAPOLATION OF ECHOES) 

• SHAPE ANALYSIS 


/L Arthur D. Little, Inc. 


4-10 



MEES. .PATTERN RECOGNITION PROBLEMS 


We have identified four types of desired pattern recognition 
t variable-specific 

(EXAMPLES: PRESENCE OF HAIL, CLOUD-TOP TEMPERATURE 

THRESHOLD) 

• BOUNDARY LOCATION 

(EXAMPLES: SQUALL LINES, SEA BREEZE FRONT) 

• CELL LOCATION AND TRACKING 

• CELL CLUSTER IDENTIFICATION AND MONITORING 
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OBSERVATIONS OF VARIABLE-SPECIFIC PATTERN .RECOGNITION 


• Simple logic is often sufficient 

t Combine IR and visible when satellite imagery 

• Doppler radar offers a rich source of data for pattern 
recognition 

• cloud motions do not fit atmospheric winds very well 
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OBSFRVATIQNS ON BOUNDARY LOCATION 


t SEARCHING FOR CONVERGENCE ZONES IS FEASIBLE, BUT IT 
WOULD REQUIRE COMBINING WITH CLOUD POSITIONS: SQUALL 

LINES ARE EASIER. 

• DOPPLER ALGORITHMS EXIST FOR IDENTIFYING GUST FRONTS, 
BUR SATELLITE DATA LACKS SUFFICIENT RESOLUTION. 

• FIXED-LOCATION BOUNDARIES (E.G., SEA BREEZE FRONT) ARE 
THE EASIEST OF ALL. 


/ti Arthur D. Little. Inc. 


4-13 


OBSERVATIONS ON CELL AND CLUSTER TRACKING 


• If identification techniques are good, images can be 

CROSS-CORRELATED. 

• Alternatively, one can use position and velocity to 

PREDICT WHERE TO LOOK NEXT, THEN CROSS-CORRELATE AT THE 
PIXEL LEVEL. 

• BECAUSE THE TIME SCALE OF CELLS JS ABOUT THE SAME AS THE 
TIME BETWEEN SATELLITE IMAGES, IT MAY BE EASIER TO TRACK 
CLUSTERS THAN CELLS. 

t Measurement noise in standard radar imagery makes it 

VERY DIFFICULT TO USE RADAR FOR AUTOMATIC CELL TRACKING. 
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PATTFRN RECOGNITION; REQUIRED RESOURCES 


• It is very difficult to state in advance without doing 

SOME EXPERIMENTATION. 

• Feasibility can be assessed in a few months, although a 

FULLY OPERATIONAL SYSTEM MAY REQUIRE MANY MAN-YEARS OF 
EFFORT. 

• the quality (and required effort) of region analysis is 

VERY DEPENDENT ON DATA QUALITY. 

• Once regions have been identified, object-level analysis 

REQUIRES MUCH LESS COMPUTATIONAL HORSEPOWER, BUT IS A 
MORE DIFFICULT PROBLEM. 
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FOUR MODELS OF MAN-MACHINE COMBINATIONS 
FOR PATTERN RECOGNITION 


1. USER INDICATES AND CLASSIFIES REGIONS OF INTEREST FROM 
RAW DATA. (OK FOR EXPERIMENTAL PURPOSES) 

d. USER INDICATES AND CLASSIFIES REGIONS USING HEAVILY 

PROCESSING DATA. (MIDDS, PROFS DO SOME OF THIS ALREADY) 

3. Machine indicates regions directly, with associated 

PARAMETERS, AND USER VERIFIES AND/OR ADJUSTS. (THIS IS 
WHAT IS CURRENTLY MOST DESIRED BY MESOSCALE FORECASTING 
COMMUNITY. ) 

4. Fully automatic. 
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P^JTFRN RECOGNITION AND W FEb PKQTQTY BE 


WE RECOMMEND MAN-MACHINE MODEL #2 BE USED IN THE WFES PROTOTYPE 
FOR THE FOLLOWING REASONS : 

• The high-level logic of the WFES prototype can be used 
to pinpoint where pattern recognition algorithms should 

BE DEVELOPED. 

• forecaster expertise lies in ThE classification and 
interaction of regions, not their detection. 

• REGION-LEVEL PROCESSING ULTIMATELY CAN BE PERFORMED BY 
THE OBSERVER, THUS FREEING THE FORECASTER FROM WHAT 
COULD OTHERWISE BE ROUTINE DRUDGERY. 
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APPENDIX 5 
TASK 5 

DATA SYSTEMS AND TOOLS 
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TASK 5: DATA SYSTEMS AND TOOLS 

WFES DATA SOURCES 


It was recognized from the outset of this project that 

EFFICIENT ACCESS TO GOFF ' S DATA SOURCES WAS A CRITICAL NEED FOR 
THE SUCCESSFUL CONSTRUCTION of an expert system. 

An analysis was therefore performed to determine which 

WORKSTATION TECHNOLOGY WAS PREFERABLE FOR USE IN THE WFES. 

IT WAS FOUND THAT IN THE NEAR TERM, THERE ARE ONLY TWO 
REALISTIC ALTERNATIVES : 

• The McIdas system from the University of wisconisn, 

WHICH FORMS THE BASIS OF THE CURRENT MIDDS SYSTEM; 

• The PkuFS software developed at the Environmental 
Research Laboratory (ERL) in Boulder, especially the 
PROFS Operational workstation (PGWS). 

Both systems have their own advantages and disadvantages. 
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Data Analysis 
Availability 
Cost (from scratch) 
Cost to NASA/KSC 


TASK 5: DATA SYSTEMS AND TOOLS 

POWS VS. MIDDS: CONCLUSIONS 


IF MIDDS WAS NOT INSTALLED AT CCFF AND POWS WAS ALREADY 
AVAILABLE. THEN POWS WOULD BE THE PREFERABLE OPTION. 


THE POWS SYSTEM WILL NOT BE AVAILABLE UNTIL AFTER 10S7 t THIS 
ALONE MAKES IT UNSUITABLE FOR THE WFES. 


The extra cost of installing a POWS at CCFF is large, pkobably 
OVER S60UK. 


MIDDS IS definitely the preferred option in the near term, 

THOUGH NOT NECESSARILY IN THE LONG TERM. 


It IS POSSIBLE TO DESIGN THE WFES SO THAT IT CAN BE TRANSFERRED 
TO A POWS AT A LATER DATE, IF THAT IS DESIRABLE. 
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TASK b: DATA SYSTEMS AND TOOLS 

OVERVIEW 


The CCFF is as well-equipped for nowcasting as any other 

FORECASTING FACILITY IN THE WORLD. IT IS PARTICULARLY 
WELL-EQUIPPED FOR SHORT-RANGE THUNDERSTORM FORECASTING: 

§ REGIONAL SATELLITE IMAGERY AT FREQUENT INTERVALS 

• LOCAL VERTICAL SOUNDINGS 

• MESOSCALE WIND NETWORK 

• LAUNCH TOWER WINDS AND TEMPERATURES 

• LIGHTNING MONITORS: LLP, A.D. LITTLES 

• FIELD MILL NETWORK 

• MIDDS 

• RADAR 

• VOLUMETRIC RADAR (PLANNED) 

• UOPPLER RADAR (PLANNED?) 

• LFM 

• FAX 
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TASK S: DATA SYSTEMS AND TOOLS 

STATUS 


f THE BASIC PkQBLEM AT CCFF IS THAT FORECASTERS HAVE NOT YET 
LEARNED HOW TO USE AND INTERPRET THE DATA SOURCES WHICH ARE 
AVAILABLE TO THEM. 

• The NEED FOR SIMULTANEOUS USE AND INTERPRETATION OF THOSE 
DATA SOURCES MAKES THE PROBLEM MORE ACUTE. 

• The current situation is through no particular fault of the 
Air Force 

MANY OF CUFF'S DATA SOURCES ARE STILL EXPERIMENTAL 

Very few people are experienced in using and 

INTERPRETING CUFF'S DATA SOURCES 

EVEN FEWER PEOPLE ARE EXPERIENCED IN THE OPERATIONAL 
USE OF Ail OF CCFF ' S DATA SOURCES 
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TASK S: DATA SYSTEMS AND TOOLS 

ASSESSMENT 


A SERIOUS NEED EXISTS FOR A FACILITY WHICH ALLOWS THE 

FORECASTER TO MAKE OPERATIONAL USE OF ThE AVAILABLE DATA IN AN 
INTEGRATED WAY. 

The completion of M1DDS will solve part of the problem by 

BRINGING TOGETHER ALL DATA SOURCES INTO A SINGLE LOCATION, BUT 
DIFFICULTIES WILL REMAIN: 

t IT WILL BE IMPOSSIBLE TO HAVE A SIMULTANEOUS VIEW OF 
SYNOPTIC-SCALE, MESOSCALE AND MICROSCALE CONDITIONS: 

• SIMPLY OVERLAYING MULTIPLE DATA ONTO A SINGLE MAP WILL 
NOT HELP MUCH, SINCE THERE HAS BEEN LITTLE OPERATIONAL 
EXPERIENCE WITH SUCH OVERLAYS: 

• EXOTIC, UNFAMILIAR DATA SOURCES (SUCH AS DOPPLER RADAR 
AND WATER VAPOR IMAGERY) WILL STILL BE EXOTIC AND 
UNFAMILIAR. 

An AI-BASED SYSTEM CAN HELP IN CAPTURING EXPERIENCE GAINED 
THROUGH THE USE OF UNFAMILIAR DATA SOURCES, AND MAKING THAT 
EXPERTISE AVAILABLE TO THE ENTIRE FORECASTING STAFF. 




/ts. Arthur D. Little, Inc. 


WFES DEVELOPMENT OPTIONS 
HARDWARE 

Considering hardware costs alone, the following alternatives go 

FROM THE LEAST TO THE MOST EXPENSIVE: 

• IBM MAINFRAME (MIDDS HOST) 

t Personal computer 

• XEROX 1186 LISP MACHINE 

PC GRAPHICS MONITOR 
XEROX GRAPHICS MONITOR 

• SYMBOLICS 3600 LISP MACHINE 

PC GRAPHICS MONITOR 
SYMBOLICS COLOR MONITOR 
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WFES DEVELOPMENT OPTIONS 
SOFTWARE ENVIRONMENT 


THE WFES ENVIRONMENT IS THAT SET OF AI"6ASED PROGRAMMING TOOLS 
WHICH DEFINE THE ALLOWABLE DATA STRUCTURES AND INFERENCING 
SCHEMES TO BE USED IN THE WFES. 


The GENERAL FUNCTION OF AN AI-BASED ENVIRONMENT IS TO ALLOW THE 
PROGRAMMER (AND ULTIMATELY THE USER) TO COMMUNICATE WITH THE 
COMPUTER AT A HIGH LEVEL OF ABSTRACTION. 


FOUR CHOICES FOR THE WFES ENVIRONMENT WERE SERIOUSLY CONSIDERED 


• ART from Inference Corporation* 

• KEE FROM 1NTELLICORP; 

• KNOWLEDGE CRAFT FROM CARNEGIE GROUP; 

• A SPECIALIZED. WFES-SPECIFIC ENVIRONMENT USING A 
COMBINATION OF LISP AND PROLOG. 
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WFES DEVELOPMENT OPTIONS 
SOFTWARE ENVIRONMENT 


The design of the wfes does not correspond exactly to any of 

ThE KNOWLEDGE REPRESENTATION SCHEMES USED IN THE 
COMMERICALLY'A VAIL ABLE SOFTWARE PACKAGES. 

All of the commercial packages would have to be considerably 

EXTENDED WITH CUSTOMIZED "WRAPPERS , " BUT ALSO HAVE A NUMBER OF 
USEFUL FEATURES. THEY SHARE THE FOLLOWING ADVANTAGES: 

• FASTER PROGRAMMING, ESPECIALLY IN THE BEGINNING: 

• EXTENSIVE DOCUMENTATION; 

• SOFTWARE SUPPORT: 

• FUTURE PRODUCT EXTENSION; 

• FUTURE CAPABILITY TO TRANSFER TO A CONVENTIONAL 
computer (Art , KEE). 


A SPECIALIZED ENVIRONMENT WOULD BE LARGELY DEFINED BEFORE 
SIGNIFICANT PROGRAMMING BEGAN, AND WOULD BE CAREFULLY TAILORED 
TO THE WFES' NEEDS. IT HAS THE FOLLOWING ADVANTAGES: 

• FASTER EXECUTION SPEED, PERHAPS MUCH FASTER: 

• GREATER FLEXIBILITY; AND 

• SIMPLER DESIGN. 
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• The major cost of any KBS is for personnel 

t DIFFERENT CRITERIA APPLY TO SELECTING A DEVELOPMENT 
ENVIRONMENT VERSUS A DELIVERY ENVIRONMENT 

t SPECIALIZED LISP MACHINES WERE DESIGNED TO OPTIMALLY 
SUPPORT AI DEVELOPMENT WORK 


NASA AND ADL ALREADY OWN SYMBOLICS 3600S 
NASA ALREADY OWNS ART LICENSES 
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AI HARDWARE AriD SOFTWARE ISSUES t DELIVER! 


SELECTION OF A DELIVERY ENVIRONMENT SHOULD BE 
POSTPONED UNTIL KBS REQUIREMENTS ARE UNDERSTOOD 

CURRENT TRENDS IN COMPUTER SCIENCE SUPPORT POSTPONING 
CHOICE OF DELIVERY ENVIRONMENT: 

- significantly reduced costs of AI delivery 

ENVIRONMENTS 

- Increasing numbers of architectures for integrating 

AI AND CONVENTIONAL HARDWARE 

- GREATER EASE IN PORTING AI SOFTWARE 
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WFES DEVELOPMENT OPTION 
USER INTERFACE 


IT IS IMPERATIVE THAT THE WFES PROVIDE THE USER WITH A HIGHLY 
INTERACTIVE ENVIRONMENT FOR ASSESSING TODAY'S WEATHER 
CONDITIONS . 


WE HAVE ASSUMED THAT MlODS IS THE ONLY SOURCE OF DATA FOR THE 

WFES. 


THE FOLLOWING INTERFACE OPTIONS, THEREFORE. CONCENTRATE ON THE 
POSSIBLE MIDDS-WFES CONNECTIONS AND THEIR RESULTANT 
IMPLICATIONS FOR THE USER INTERFACE. 
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NIDUS ROLE 


Multiple loprocessing: 

All future operational forecasting systems will have 

MULTIPLE COPROCESSOR ARCHITECTURES. 

DIFFERENT PROCESSING ALGORITHMS: 

This stems from fundamental differences in information 

PROCESSING REQUIREMENTS AT DIFFERENT NODES IN THE SYSTEM. 

DATA DISPLAY SYSTEM ESSENTIAL : 

MIDDS IS THE ONLY CURRENTLY OPERATIONAL DATA DISPLAY AND 

ANALYSIS SYSTEM. 

WFES REQUIRES MIDDS: 

The WFES will require a system like MIDDS, but its 

ARCHITECTURE IS NOT DEPENDENT UPON MIDDS PER .££.« 

MIDDS ARCHITECTURE: 

THE MIDDS IBM A1 ARCHITECTURE IS OPEN ENOUGH TO PERMIT A 
WIDE RANGE OF COUPLING OPTIONS. 
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WFES C0UPLIWL JILMI1M 


NO DIRECT COUPLING: 

KEYBOARD ENTRY FOR DATA INTO WFES. 
DIGIPAD ENTRY OF IMAGES INTO WFES. 


SERIAL LINK FOR COMMANDS: 

AI-BASED USER INTERFACE ON WFES. 

BACKEND MIDDS COMMAND GENERATOR WITHIN WFES. 

HIDDS IBM AI I/O DRIVER. 

Ethernet link For nonimage Data: 

ETHERNET CARD AND SOFTWARE FOR MIDDS IBM AI WORKSTATION 
NETWORK DRIVER SOFTWARE ON WFES. 


Ethernet link For Image Data: 

ETHERNET CARD AND SOFTWARE FOR MIDDS IBM AI WORKSTATION 
WFES NETWORK DRIVER SOFTWARE PATCH. 

COLOR GRAPHICS DISPLAY PACKAGE FOR WFES (HARDWARE 

SOFTWARE ) . 

DIRECT USE INTERACTION WITH MIDDS IMAGE DATA DISPLAY: 

MAJOR EXPANSION OF MIDDS IBM AI I/O DRIVERS. 

INCORPORATE MOUSE TO DATA MAPPING PROCESSES ON AI . 

Direct User Interaction with WFES Image Data Display: 

PART OF COLOR GRAPHICS DISPLAY PACKAGE FOR WFES. 
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WFES Development Options 




WFES Development Options 
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WFES Development Options 
User Interface (Continued) 
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CHOICE OF DFGREE OF COUPLING 


Stage of Development cycle: 

First stage will not require a direct coupling. 

The serial link should be built as soon as possible, but 
requires NIDDS to be adjacent WFES. 

The ADDITION OF ThE COLOR GRAPHICS SYSTEM: 

Greatly enhances the likely success of WFES 

WILL BE ESSENTIAL FOR AN OPERATION TEST OF THE WFES 
Enhances independence from MIDDS 
Level of Funding: 

The serial link should be implemented independent of 

FUNDING LEVEL. 

THE ETHERNET LINK IS PROBABLY NOT WORTH IMPLEMENTING 
WITHOUT THE COLOR GRAPHICS SYSTEM. 

THE COLOR GRAPHICS SYSTEM IS THE MOST EXPENSIVE LEVEL OF 
COUPLING, BUT WOULD ADD ENTIRELY NEW DIMENSIONS TO THE WFES 
CAPABILITIES . 
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WFES DEVELOPMENT OPTIONS 
OVERVIEW 


A WIDE RANGE OF DEVELOPMENT OPTIONS EXISTS FOR THE WFES 
PROTOTYPE . 

THESE OPTIONS MAY bE DIVIDED INTO THREE MAIN CATEGORIES. 

• Functionality 

• HARDWARE 

• user Interface 
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WFES DEVELOPMENT OPTIONS 
FUNCTIONALITY 

DOING FROM THE SIMPLE TO THE COMPLEX, THE FOLLOWING WFES 
FUNCTIONS WERE EXPLORED: 

• AUTOMATED FORECASTING WORKSHEET 

• Alarm monitors for specific phenomena such as: 

MET WATCH 

fog 

THUNDERSTORM ACTIVITY 
FRONTAL MOVEMENT 

• A GOAL-DRIVEN FACILITY FOR ANSWERING SPECIFIC QUERIES 
ABOUT TODAY'S WEATHER CONDITIONS, BACKED BY A RATHER 
DETAILED, PHYSICALLY-BASED MODEL. 

• SCENARIO-BASED DETECTION, MONITORING AND ANTICIPATION 
OF "INTERESTING" WEATHER EVENTS. 


Al Arthur D. Little, Inc. 


5-24 


f 

t 

i 


F 

i 


\ 

i 

s 

i 

i 

? 


APPENDIX 6 
TASK 6 

PROTOTYPE WEATHER FORECASTING EXPERT SYSTEM 
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WFES OPERATION 


THE WFES WILL bE A HIGHLY interactive system that stresses the 
SYMBOLIC REPRESENTATION OF TODAY'S WEATHER EVENTS. WFES 
OPERATION WILL HAVE THE FOLLOWING CHARACTERISTICS: 

• It will operate on a 24-hour CYCLE, and will be 

INITIALIZED EARLY IN THE MORNING OF EACh DAY. 

• AS THE DAY PROGRESSES, THE SYSTEM'S ATTENTION WILL 
FOCUS ON PHENOMENA WITH PROGRESSIVELY FINER TEMPORAL 
AND SPATIAL SCALES. 


SYNOPTIC, MESOSCALE AND MICROSCALE SCENARIOS WILL BE 
LINKED TOGETHER TO FORM COHERENT STORIES. 


Multiple scenarios will be considered simultaneously 


• The focus will be on helping the forecaster anticipate 

SIGNIFICANT PHENOMENA UP TO SEVERAL HOURS AHEAD. 

• IT WILL MI AUTOMATICALLY GENERATE FORECASTS. 


e-2 
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UFFINITIQNS OF EVALUATION TERMS 


LOW" - FORECASTING: THE POINT-OF*KEFEKENCE IS A NEW DUTY 

FORECASTER . 

AI TECHNOLOGY: OTHER COMPUTER SCIENCE TECHNOLOGIES 

PROBAbLY COULD BE USED AS WELL. 

NASA: PROJECT DOES NOT DIRECTLY ADDRESS KEY 

PROBLEMS, BUT MAY HAVE VALUE. 

LEVEL OF EFFORT: ONE-PERSON YEAR. 

HIGH" - FORECASTING: EQUIVALENT TO MOST EXPERT FORECASTER. 

AI TECHNOLOGY: MOST ADVANCED COMMERCIALLY VIABLE Al 

TECHNOLOGY . 

hiASA: DIRECTLY ADDRESSES KEY PROBLEM. 

LEVEL OF EFFORT: SIX-PERSON YEARS. 
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Low 

iitUIUM 

High 

VfhY High 



MFTWATCH ADVISOR!^ 


LEVEL OF EXPERTISE: 


(XFF EXPERIENCE: 


AI REQUIRED: 


NASA BENEFITS: 


LEVEL OF EFFORT: 


LOW: ROUTINE PART OF GENERAL METEOROLOGICAL 

TRAINING FOR AF FORECASTERS. 

LOW TO MODERATE: CCFF UNIQUE FEATURES 
LEARNED VERY QUICKLY AS PART OF ON-THE-JOB 
TRAINING. 

LOW: DEPENDING UPON IMPLEMENTATION 

AUTOMATION COULD BE ACCOMPLISHED WITH 
TRADITIONAL DAT ABASE / FORMS GENERATOR METHODS. 

LOW; WOULD AID IN DISSEMINATION OF 
INFORMATION, BUT WOULD NOT DIRECTLY ADDRESS 
KEY PROBLEMS. 

LOW. 
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AUTOMATED FORECAST WORKSHEET 


LEVEL OF EXPERTISE : 

CCFF EXPERIENCE: 

Al REQUIRED: 

NASA BENEFITS: 

LEVEL OF EFFORT : 


LOW: ONE OF FIRST POINT OF TRAINING FOR N 
FORECASTERS. 

LOW: IBID. 

LOW: PRIMARY TECHNIQUE WOULD BE OATABASE / 
FORMS GENERATION: AI COULD BE USED TO 
PROVIDE ERROR DETECTION AND TO DYNAMICALLY 
CHANGE INPUT FORMS DEPENDING UPON VALUES 
INPUT TO SHEET. 

LOW; MARGINAL IMPROVEMENT ABOVE PAPER AND 
PENCIL VERSION, UNLESS EXTENDED TO COMPLEX 
PATTERN CHECKING. 

LOW: LEVEL OF EFFORT WOULD INCREASE IN 
PROPORTION TO AI CONTENT. 
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EQUIPMENT SPECIFIC: PATTERN ILENTIFIGATIQh 


LEVEL OF EXPERTISE: 

CCFF EXPERIENCE: 

AI REQUIRED: 

NASA BENEFITS: 

LEVEL OF EFFORT: 
GENERAL COMMENTS: 
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MEDIUM: DEPENDS UPON DATA SYSTEM AND WHETHER 
SYSTEM IS WIDELY USED IN AF OR IS NASA 
SPECIFIC: ALSO DEPENDS UPON SUBTLENESS OF 
PATTERN. 

MEDIUM TO HIGH: IBID. 

SEE DISCUSSION OF "PATTERN RECOGNITION." 

LOW OR HIGH: AUTOMATIC RECOGNITION OF 
COMPLEX PATTERNS WOULD DIRECTLY RELATE TO 
PROBLEM OF INFORMATION OVERLOAD: GIVEN 
ENOUGH STAFF, HUMANS PRESENTLY ARE VERY 
FACILE AT PATTERN RECOGNITION. 

VERY HIGH: LOW TO ASSESS FEASIBILITY: VERY 
HIGH TO MAKE OPERATIONAL. 

For the newer data systems at KSC, 

SIGNIFICANT PATTERNS ARE JUST BEING 
IDENTIFIED (E.G., LIGHTNING SYSTEMS AND 
WINDS): MOST DUTY FORECASTERS ARE EXPERT ON- 
ONE SYSTEM: NO ONE IS EXPERT ON ALL SYSTEMS: 
IDENTIFICATION OF MANY METEOROLOGICAL 
"FEATURES" (E.G., A "CELL") REQUIRES INPUT 
FROM SEVERAL DATA SYSTEM. 
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FQUTPMFNT SPECIFIC: PAT TFRN INTERPRETATION 


LEVEL OF EXPERTISE: 


OCFF EXPERIENCE: 


A1 REQUIRED; 


NASA BENEFITS: 


LEVEL OF EFFORT: 


6ENERAL COMMENTS: 


MEDIUM; VARIES WITH DATA SYSTEM AND THE 
IMPORTANCE OF PATTERN TO CURRENT WEATHER 
SCENARIO. 

MEDIUM TO HIGH; IBID; LIMITED EXPERTISE 
EXISTS FOR NEWER SYSTEMS. 

MEDIUM TO HIGH; VARIES WITH COMPLEXITY OF 
PATTERN (E.G., TOWER DATA VERSUS SATELLITE 
IMAGES): SEE DISCUSSION OF "PATTERN 

Recognition . " 

MEDIUM; IMPROVING INTERPRETATION OF PATTERNS 
ON SINGLE DATA SYSTEMS NOT AS IMPORTANT TO 
KEY PROBLEMS AS INTERPRETATION OF PATTERNS 
ACROSS DATA SYSTEMS. 

MEDIUM FOR EACH COMPLEX PATTERN: LOW FOR 
SOME (E.G., TOWER SENSOR ARRAY). 

There are many different levels of meaning 

ATTACHED TO "INTERPRETATION" OF PATTERNS: 
INFORMATION OVERLOAD OFTEN STEMS FROM NOT 
KNOWING WHICH PATTERNS TO LOOK FOR. WITH THE 
ALTERNATIVE THEN BEING TO LOOK FOR ANY 
POSSIBLE PATTERN. 
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ALARM MONITORING 


LEVEL OF EXPERTISE: 


CCFF EXPERIENCE: 


AI REQUIRED: 


NASA BENEFITS: 


LEVEL OF EFFORT: 


GENERAL COMMENTS: 


LOW; ASSUMES PERSON MONITORING ONLY FOR 
PRESENCE OF PATTERN OR CHANGE IN PATTERN. 

LOW; ASSUMES PATTERN HAS BEEN IDENTIFIED BY 
EXPERT AS BEING IMPORTANT. 

LOW TO MEDIUM; ASSUMES A PATTERN FOR 
MONITORING HAS BEEN CHOSEN HAS 
CHARACTERISTICS WHICH CAN BE AUTOMATICALLY 
IDENTIFIED; REPRESENTATION AND REASONING 
ABOUT TIME WILL MAKE ThIS A DIFFICULT 
PROBLEM ON SOME DATA SYSTEMS. 

LOW TO MEDIUM; AUTOMATING A SINGLE ALARM 
SYSTEM PROBABLY HAS ONLY LIMITED IMPACT ON 
KEY PROBLEMS. 

LOW TO MEDIUM; DEPENDS ON PARTICULAR SET OF 
DATA SYSTEMS AND COMPLEXITY OF PATTERN. 

Monitoring system for complex patterns 

CONVERGES TO SCENARIO SYSTEM. 
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NASA STS REQUIREMENTS 


LEVEL OF EXPERTISE: 


CCFF EXPERIENCE: 


AI REQUIRED: 


NASA BENEFITS: 


LEVEL OF EFFORT: 


GENERAL COMMENTS: 
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MEDIUM; REQUIRES FORECASTER TO HAVE INTEREST 
BEYOND METEOROLOGY. 

MEDIUM; STAFF METS TAKE MONTHS TO LEARN ALL 
OF THE PARTICULARS; A YEAR TO BE EXPERT. 

LOW TO MEDIUM; DEPENDS UPON COMPLEXITY OF 
IMPLEMENTATION DETAILS SUCH AS KNOWLEDGE 
REPRESENTATION SCHEME AND THE NUMBER OF 
OPERATIONAL CONSTRAINTS INCLUDED. 

LOW TO MEDIUM; AUTOMATING STS LAUNCH AND 
LAND REQUIREMENTS HAS LOW BENEFIT UNDER 
PRESENT CONDITIONS; COULD BE MEDIUM WITH 
INCREASING FREQUENCY OF LAUNCH, OR INCLUSION 
OF MOST OPERATIONAL CONSTRAINTS. 

MEDIUM; AUTOMATING JUST LAUNCH AND LANDING 
REQUIREMENTS IS A SUBSTANTIAL PROJECT. 

INFORMATION ABOUT WEATHER-SENSITIVE GROUND 
OPERATIONS IS WIDELY DISPERSED ACROSS NASA 
PERSONNEL; GATHERING THAT INFORMATION WOULD 
BE A MAJOR PIECE OF WORK AND BENEFICIAL IN 
AND OF ITSELF; WOULD GREATLY IMPROVE 
COMMUNICATION BETWEEN NASA AND CCFF. 
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BCFNARIG-BASFD SYSTEM; PREDEFINED SCENARIOS 


LEVEL OF EXPERTISE: 


CCFF EXPERIENCE: 


Al REQUIRED: 


NASA BENEFITS: 


LEVEL OF EFFORT: 


GENERAL COMMENTS: 


MEDIUM; ONCE DELINEATED, DUTY FORECASTERS 
SHOULD BE ABLE TO UTILIZE THEM. 

HIGH; THE IDENTIFICATION OF SCENARIOS IS 
HEAVILY DEPENDENT UPON LENGTH OF EXPERIENCE 
AT CCFF. 

HIGH; PROBABLY THE ONLY APPROPRIATE 
TECHNOLOGY FOR CAPTURING AND PROGRAMMING 
SCENARIOS. 

MEDIUM TO HIGH; DEPENDS UPON THE SUCCESS OF 
ELICITING AND REPRESENTING IMPORTANT 
SCENARIOS FROM IDENTIFIED EXPERTS; PROJECT 
DIRECTLY ADDRESSES BOTH ACCUMULATION OF 
EXPERTISE AND INFORMATION OVERLOAD PROBLEMS. 

MEDIUM; THE PRIMARY PURPOSE SHOULD BE TO 
EVALUATE THE VALIDITY OF USING SCENARIOS TO 
CAPTURE THE NATURE OF FORECASTING EXPERTISE 
AT CCFF. 

This project defines one end of a continuum 

OF PROJECTS THAT COULD BE DONE; IT 
REPRESENTS THE MINIMUM PROJECT TO EVALUATE 
TECHNICAL FEASIBILITY OF USING SCENARIOS TO 
CAPTURE FORECASTING EXPERTISE AT NASA. 
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vcmotRTB-BASED a tsiau SFLF-MOIVfFYTNQ SC E NAR IOS 


LEVEL OF EXPERTISE: 
CCFF EXPERIENCE: 

AI REQUIRED: 

NASA BENEFITS: 
LEVEL OF EFFORT : 
GENERAL COMMENTS: 


HIGH: ASSUMES CONSIDERABLE FLEXIBILITY IN 
THINKING ABOUT FORECASTING WEATHER EVENTS. 

HIGH: THE GENERATION AND MODIFICATION OF 
SCENARIOS IN REAL-TIME IS ONE OF THE 
IDENTIFYING SKILLS OF AN EXPERT FORECASTER 

AT CCFF. 

HIGH: ELEMENTS OF EVERY KNOWLEDGE 
REPRESENTATION SCHEME PRESENTLY IN GENERAL 
USE WOULD BE REQUIRED FOR THIS SYSTEM, PLUS 
THE JUDICIOUS USE OF EMERGING TECHNIQUES. 

HIGH: PROJECT WOULD DIRECTLY HELP SOLVE NASA 
KSC'S TWO KEY PROBLEMS. 

HIGH: THIS PROJECT WAS THE ONE PROPOSED AT 
OUR FIRST ORAL PRESENTATION. 

The PROJECT DEPENDS ONLY UPON PROVEN AI 
TECHNIQUES: ITS COMPLEXITY STEMS FROM THE 
NUMBER OF TECHNIQUES WHICH WOULD BE 
COMBINED: THE INCORPORATION OF QUALITATIVE 
PHYSICS INTO THE SYSTEM AS THE BASIS FOR 
SELF-MODIFICATION WOULD BE THE MOST ADVANCED 
TECHNIQUE USED, WHICH HAS BEEN USED TO DATE 
ONLY IN A FEW R&D PROJECTS. 
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INTERPRETING MESOSCALE MODELS 


LEVEL OF EXPERTISE: 
CCFF EXPERIENCE: 

AI REQUIRED: 

NASA BENEFITS: 

LEVEL OF EFFORT: 

GENERAL COMMENTS: 


High » requires both advanced education and 

SIGNIFICANT EXPERIENCE. 

High » models would have to be specific to 
CCFF climatology to be useful. 

HIGH: MIXTURE OF MATHEMATICAL AND SYMBOLIC 
REASONING places project IN R&U category. 

HIGH; IF SUCCESSFUL, PROJECT COULD PROVIDE 
SPECIFIC, DETAILED FORECASTS. 

Very high; probably prohibitive, given R&D 

NATURE OF BOTH THE DEVELOPMENT OF MESOSCALE 
MODEL AND APPROPRIATE AI TECHNIQUES. 

Project included because it represents the 

MOS IDEAL APPROACH CONCEIVABLE AT THIS POINT 
IN TIME, IF IT WERE FEASIBLE. 
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WFES PROTOTYPE 
SYSTEM DESIGN 


Functions 

• ASSIST THE FORECASTER IN ANTICIPATING SIGNIFICANT WEATHER 
EVENTS WHICH RELATE TO THUNDERSTORM FORMATION. 

t Capture forecaster knowledge of particular weather 

SCENARIOS FOR LATER USE. 

• Provide a common facility for forecaster-to-forecaster 

COMMUNICATION. 

• ALLOW A FORECASTER TO MAINTAIN A CONTINUOUS TRAIN OF 
THOUGHT, DESPITE FREQUENT INTERRUPTIONS. 
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WFES PROTOTYPE 
SYSTEM DESIGN 


BENEFITS 

t Provide more consistent short-range thunderstorm 

FORECASTING. 

• BRING INEXPERIENCED FORECASTERS "UP TO SPEED" MUCH MORE 
QUICKLY. 

• Reduce the constant loss of forecasting expertise through 

FORECASTER ROTATION. 

• CAPTURE AND USE FORECASTER EXPERTISE IN A WAY WHICH 
DIRECTLY PARALLELS THE FORECASTING PROCESS. 
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WFES PROTOTYPE 
SYSTEM DESION 


qata Structured 

THE DATA STRUCTURES USED IN THE WFES WILL DRIVE THE LOGIC WHICH 
IS NEEDED TO MANIPULATE THOSE STRUCTURES. THE PRIMARY DATA 
STRUCTURES ARE: 

• Feature - an individual weather entity, usually 

ASSOCIATED WITH A SMALL SET OF 
METEOROLOGICAL OBSERVATIONS. 

• EVENT - A QUALITATIVE CHANGE IN A FEATURE OR SET 

OF FEATURES. 

• SCENARIO ” A SEQUENCE OF EVENTS WHICH CORRESPONDS TO 

AN IDENTIFIABLE TYPE OF WEATHER BEHAVIOR. 
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WFES KNOWLEDGE: SCENARIOS 


SCENARIOS WILL BE: 

t THE FUNDAMENTAL SOURCE OF THE WEES' FORECASTING EXPERTISE 
f THE DRIVING FORCE BEHIND THE REST OF THE WFES ARCHITECTURE 

• BASED UPON GENERIC, RATHER THAN HISTORIC, DAYS 

• SYMBOLIC "SKETCHES" WHICH CORRESPOND AS CLOSELY AS 
POSSIBLE TO STORIES TOLD BY ONE FORECASTER TO ANOTHER 
FORECASTER 

• SPLIT INTO THREE DISTANCE SCALES: 

SYNOPTIC: 

MESOSCALE: 

MICROSCALE. 

COMBINATIONS AT MULTIPLE SCALES WILL BE ALLOWED. 

• ORDERS OF MAGNITUDE SMALLER THAN A DUMP OF ONE DAY'S RAW 
DATA 
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WFES DATA STRUCTURES 
ATTRIBUTES 


SCENARIO 

• EVENTS (TREE) 

I SPATIAL SCALE 

• Rules of Thumb 

• ASSUMPTIONS 

- NECESSARY 

- SUFFICIENT 

• "NOW" 
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EXAMPLE 

evenii 


scale 

"Rules of 
Thumb" 

assumptions 


SCFNARIO: CONVERGEN CE -DRIVEN CONVECTION 

IN S W FLORIDA 


SU-NE CONVERGENCE ZONE 
ARC LINES 

T-STORMS BETWEEN OKECHOBEE AND TAMPA 
NEW CELLS FORMING TO THE NE 
MESOSCALE 

OKECHOBEE LAKE BREEZE CAN STRENGTHEN CONVECTION 
SEVERITY GOES UP WITH INCREASING WINDS ALOFT 
LATE SEA BREEZE ACCENTUATES EFFECT (LOCALLY) 
LONG ARC LINES (EXTENDING TOWARD CUBA) INDICATE 
WELL-ENTRENCHED PATTERN 

RIDGE AXIS TO SOUTH 

CLOUD COVER ALLOWS SUFFICIENT CONVECTION 
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PM 


AX 
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WFES DATA STRUCTURES 
ATTRIBUTES 


ima 

• Features 

• Predicate 

• Time Stamp 

- relative if in knowledge base 

- SPECIFIC IF INSTANTIATED 

• Explanation of causality * 

• SPATIAL SCALE 

• OBSERVATION INTERVAL 

- DETECTION 

- MONITORING 

• MEASUREMENT METHODS 
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EXAMPLE EVENT: SW-TQ-NE CONVERGENCE ZONE D£YELI £S 


Features 
Predicate 
Time Stamp 
causality 

SPATIAL SCALE 

Observation 

Interval 

Measurement 

Method 


Arc lines 

Low-level convergence forms n of ridge axis 
lbOOZ 

"Forced by dynamics on NWi side of ridge* 
Mesoscale 

1 HOUR (DETECTION) 

1/2 HOUR (MONITORING) 

Visual examination of satellite imagery 
[Algorithm with detects long, parallel cloud 

STREETS?] 
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WFES DATA STRUCTURES 
ATTRIBUTES 


Feature 

• Values 

• Location 

• Lifetime 

• HISTORY 

• Climatology (if it exists) 

t SIZE (IF APPLICABLE) 
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FX AMPLE FEATURE: A Kl LIKES 


Values. 

location 

Lifetime 

history 

climatologi 

SIZE 


1SU0-1900Z VISIBLE SATELLITE IMAGES 
NW OF OKECHOBEE 
2-8 HOURS 

(SEQUENCE OF IMAGES) 

N/A 

N/A 
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FXAMPIF: VARIABLE. FEATURE. EVENT. SCENAR IO 


Variable 

WIND AT 700 MB, 

XMR 

Feature 

Steering-level 

WINDS AT OOZ 

Event 

LIGHT PREVAILING ESTERLIES IN LATE EVENING 

SCENARIO 

MORNING SHOWERS 

BLOWN ONSHORE 
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pXANiPIF; VARIABLE - FEATURE. EVENT. SC E NAR IO ' 


Variable 

feature 

EVENT 

SCENARIO 


STEERING-LEVEL WINDS 
CONVERGENCE ZONE 

CONVERGENCE ZONE FORMS, SW~NE. WITH WINDS AT ^40, 
NW OF OKECHOBEE 

CONVERGENCE-FORCED CONVECTION ON NW SIDE OF RIDGE 
AXIS 
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EXAMPLE: VARIABLE. FEATURE, E VENT . SCENARIO. 


VARIABLE 

FEATURE 

E m i 

SCENARIO 


ELECTRIC POTENTIAL 

Areas of maximum/minimum potential 

l) Maximum or minimum crosses threshold 

c) Immediate flattening of field 

Isolated cell forms over KSC 
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Data Flow 



WFES Architecture: Detailed View of DETECT 
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ANALYZE U ►Today 



WFES Architecture: Detailed View of 
MONITOR, ANTICIPATE 
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Today ►! Match 




Request 

:6oz 

skew- I 

±_ 

MIDDS 


i 

I200Z skew- 


Local temperatures ; 
s Ask user: "Are f 

cirrus dissipating 0 ” 


Expect new Are cirrus 
skew-T after dissipating? 


SCHEDULER 


* 



PARSER 


4- Dissipating 
9 T C c . -1 

n 5 nr 



y 

Add query tc list test 
temperatures for threshc 


Divergence aloft 
strong winds c 850mb fro 


LI = -3 <5 XMR 
(High Clouds) 


Example : 


Processing of skew-T 
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I 


(Yesterday at : 

Dis sipi tatine. 

-0 . * - 
>3 nr 


_ ^ . 


v 


— ^ 


* 


decreasing 


\ 


\ 


OuciitciZiv e 


* Phvsics 


i 


Divergence alert 
strone winds 3 8 5 Omb rrc 
LI = -3 ■:= XMR 
(High Clouds) 



* i r c -.cues 
'Vr 


dissipate; Hot spots 
likelv 


A 


Wind *> 
Clouds => 

' I v - «> 
sic 


severity 

T . 
s tc 

LT 


=> - Sea Breeze 
-iT «> Late Sea Breeze 


MATCH 


Example : 


Processing of 


skev-T 


ommi PAC£ Ia 

OF POOR QUALITY 
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THE WFES PROTOTYPE 
DEVELOPMENT APPROACH 
HIGH EFFORT 


An overriding concern will be the early development of a user 

INTERFACE SUITABLE FOR KNOWLEDGE ELICITATION AND EVALUATION. 

The order of MODULE DEVELOPMENT IS CRUCIAL: 

• Those modules which are essential to making the wFES a 

USEFUL TOOL WILL BE DEVELOPED FIRST. 

• MODULES WHICH ARE PART OF THE OVERALL DESIGN BUT WHOSE 
FUNCTIONS COULD BE PERFORMED BY HUMANS WILL BE 
DEVELOPED SECOND, TIME PERMITTING. 

This insures that at each stage in the WFES development, a 

USEFUL SUBSET OF ALL FORECASTING TASKS IS BEING SUPPORTED. 
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THE WFEG PROTOTYPE 
MODULE DEVELOPMENT 
HIGH EFFORT 


Module Status 

"DETECT 

ANALYZE u 

Parser u 

SCHEDULER U 

"MONITOR" 

MATCH U 

Compare y 

UPDATE Y 

"ANTICIPATE" u 

"KNOWLEDGE" 

ANALOGS Y 

EVENTS Y 

rules of Thumb y 

CLIMATOLOGY N 

Qualitative PhYsics N 


"Y" * Must be performed by machine 

"N" - Not essential 

"u" * Could be performed by user 
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INVOLVEMENT OF FORECASTING EXPERTS AND 

future users in wfes development 


Forecasting experts and future users will be involved in four 

STAGES OF ThE DEVELOPMENT PROCESS: 

• knowledge Elicitation 

• knowledge synthesis 

t implementation 

• Test and evaluation 


/ti Arthur D. Little. Inc. 
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• Knowledge flicitation 


Purpose : 


SOURCES : 


ACTIVITIES : 


ELICITATION OF THE KNOWLEDGE WHICH WILL 
DRIVE THE WFES 

Duty Forecasters 

STAFF METEOROLOGIST 

Project Experts 
NASA EXPERTS 


Intensive debriefing 
active Observation 

ASSIGNMENTS 

REVIEW AND CRITIQUE OF THE EVOLVING SYSTEM 
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t KNOWLEDGE SYNTHESIS 


Purpose : 


SOURCES: 


ACTIVITIES: 


Structuring and Presenting Forecaster 
Expertise 


Duty Forecasters 

STAFF METEOROLOGISTS 

Project Experts 
Future users 


REVIEW OF FORECASTING KNOWLEDGE AS IT IS 
EMBEDDED IN THE WFES ARCHITECTURE 

review of Proposed user Interface 
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• Implementation 


Purpose : 


SOURCES: 


ACTIVITIES: 


TO IMPLEMENT A SYSTEM WHICH REFLECTS 
FORECASTER EXPERTISE AND FULFILLS THE NEEDS 
OF FUTURE USERS 


duty Forecasters 
staff Meteorologists 
Project Experts 
Future users 

REVIEW AND CRITIQUE OF THE kFES AS IT 
DEVELOPS 


/L Arthur D. Little. Inc. 
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• Test and 


Purpose : 


Sources : 


ACTIVITIES: 


Evaluation of the implemented WFES to 

DETERMINE PATHS FOR FUTURE DEVELOPMENT 


DUTY FORECASTERS 
NASA EXPERTS 
Project Experts 


Extended test of ThE prototype WFES at CCFF 

KNOWLEDGE ELICITATION CONCERNING THE 
OPERATION OF WFES IN REAL-TIME FORECASTING 
SITUATIONS 


/L Arthur D. Little. Inc. 


6-43 



THE RELATION BETWEEN THE PROPOSED ARCHITECTURE 
AND KNOWLEDGE ELICITATION ACTIVITIES 


The proposed architecture requires expertise on these topics 
t case histories 

• Rules of Thumb 

i Qualitative Physics 

• CLIMATOLOGY 


/ti Arthur D. Little. Inc. 
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HIGH EFFORT 
THE WFES PROTOTYPE 
YEAR 1 


AFTER A ONE-YEAR EFFORT, THE WFES PROJECT WILL PROVIDE 
SUFFICIENT INFORMATION TO ASSESS THE MAGNITUDE OF EFFORT 
REQUIRED TO BUILD AN OPERATIONAL SYSTEM. ThIS REQUIRES: 

• A DETAILED KNOWLEDGE OF : 

THUNDERSTORM FORMATION IN THE CAPE AREA; 

HOW FORECASTERS RESPOND TO ThOSE THUNDERSTORMS. 

• A SET OF SOFTWARE TOOLS WHICH MATCH THAT KNOWLEDGE, 
INCLUDING : 

A SIMPLE FACILITY FOR CLASSIFYING AND MONITORING 
"INTERESTING" WEATHER FEATURES; 

AN ENVIRONMENT FOR THE DEFINITION, STORAGE AND 
RETRIEVAL OF PROTOTYPICAL WEATHER SCENARIOS; 

A GRAPHICAL, INTERACTIVE INTERFACE TO KIDDS. 


/L Arthur D. Little. Inc. 
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HIGH EFFORT 
WFES PROJECT PLAN 
MILESTONES 


AT PROJECT MILESTONES, PROGRESS SHOULD BE REPORTED AND ASSESSED 
BY PROJECT MANAGEMENT. 

The FOLLOWING MILESTONES SEEM ESPECIALLY IMPORTANT: 

• Machine installation at CCFF for development, testing 

AND EVALUATION. 

• Completion of the capability to transfer and display 

hIDDS DATA IN THE WFES ENVIRONMENT. 

• Implementation of a basic user interface. 

• ROBUST DEFINITION OF A SCENARIO. INCLUDING: 

DATA STRUCTURES 
GRAMMAR 

• COMPLETION OF THE LOGIC FOR ANTICIPATING FUTUKE EVENTS 
AND COMPARING THEIR STATUS WITH CURRENT CONDITIONS. 


/ti Arthur D. Little, Inc. 
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HIGH EFFORT 
THE WFES PROTOTYPE 
YEAR 2 


DURING ThE SECOND YEAR, THE WFES PROJECT WILL PROVIDE A 3-MONTh 
OPERATIONAL TESTING OF A REFINED WFES PROTOTYPE DURING THE 
SUMMER OF iSb 7. 

This requires implementation of what was learned during the 

PREVIOUS YEAR AND INCLUDES: 

$ A ROBUST USER INTERFACE WHICH IS SUITABLE FOR 
UNSUPERVISED USE; 

t AN EFFICIENT ENVIRONMENT FOR EXAMINING AND UPDATING 
THE SCENARIO FILE; 

• SOPHISTICATED LOGIC FOR AUTOMATICALLY GENERATING AND 
MONITORING "INTERESTING" WEATHER SCENARIOS; 

• AUTOMATIC LINKAGE TO MIDDS CASE HISTORIES. 


/ti Arthur D. Little. Inc. 
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High Effort 
WFES Prototype 
Development Schedule 



Arthur D. Little. Inc. 
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Interface to 
Mesoscale Model 



MEDIUM EFFORT 


THE WFES PROTOTYPE 
YEAR 1 


AFTER A ONE-YEAR EFFORT, THE W/FES PROJECT WILL PROVIDE 
SUFFICIENT INFORMATION TO ASSESS THE MAGNITUDE OF EFFORT 
REQUIRED TO BUILD AN OPERATIONAL SYSTEM. THIS REQUIRES: 

• A KNOWLEDGE OF : 

THUNDERSTORM FORMATION IN THE CAPE AREA; 

HOW FORECASTERS RESPOND TO THOSE THUNDERSTORMS. 

• A SET OF SOFTWARE TOOLS WHICH MATCH THAT KNOWLEDGE, 
INCLUDING: 

A SIMPLE FACILITY FOR CLASSIFYING AND MONITORING 
"INTERESTING" WEATHER FEATURES; 

AN ENVIRONMENT FOR THE DEFINITION, STORAGE AND 
RETRIEVAL OF PROTOTYPICAL WEATHER SCENARIOS; 

A GRAPHICAL, INTERACTIVE INTERFACE TO M1DDS . 
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MEDIUM EFFORT 


WFES PROJECT PLAN 
MILESTONES 


AT PROJECT MILESTONES, PROGRESS SHOULD BE REPORTED AND ASSESSED 
BY PROJECT MANAGEMENT. 

THE FOLLOWING MILESTONES SEEM ESPECIALLY IMPORTANT: 

• MACHINE INSTALLATION AT CCFF FOR DEVELOPMENT, TESTING 
AND EVALUATION. 

• COMPLETION OF THE CAPABILITY TO TRANSFER AND DISPLAY 
MIUUS DATA IN THE WFES ENVIRONMENT. 

• IMPLEMENTATION OF A BASIC USER INTERFACE. 

• DEFINITION OF A SCENARIO. INCLUDING: 

DATA STRUCTURES 
GRAMMAR 

f OF THE LOGIC FOR ANTICIPATING FUTURE EVENTS AND 
COMPARING THEIR STATUS WITH CURRENT CONDITIONS. 
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MEDIUM EFFORT 


THE WFES PROTOTYPE 
YEAR 2 

D-UkING the second year, the WFES project will provide a s-month 

OPERATIONAL TESTING OF A REFINED WFES PROTOTYPE DURING THE 
SUMMER OF 1067. 

This requires implementation of what was learned during the 

PREVIOUS YEAR AND INCLUDES: 

• A USER INTERFACE WHICH IS SUITABLE FOR SUPERVISED USE: 

• AN ENVIRONMENT FOR EXAMINING AND UPDATING THE SCENARIO 
FILE ; 

• SOPHISTICATED LOGIC FOR SELECTING AND MONITORING 
"INTERESTING" WEATHER SCENARIOS: 

• AUTOMATIC LINKAGE TO MIDDS CASE HISTORIES. 


/L Arthur D. Little. Inc. 
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MEDIUM EFFORT 


U'FFS PROTOTYPE COSTS 


Yeah One 


Scenario definition SiOOK 
user Interface 25K 
M1DDS SERIAL Link SK 
Preliminary System Logic 60K 
ON-SITE DEVELOPMENT (KE) SDK 
A1 Design evaluation 10K 


. $250K 


Year Two 


Scenario Knowledgebase $15GK 
system logic 60K 
KSC Testing 70K 

EVALUATION 


$SQGK 


S5S0K 


/L Arthur D. Little, Inc. 
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MEDIUM EFFORT 


SUMMARY UFES PROTOTYPE COSTS 

SCENARIO DEVELOPMENT (KNOWlEDGE-bASE ) S250K Hbl 

Systems control logic (Inference Engine) IOuK 

User Interface and MIDDS link IOUK 18X 

Evaluation and Testing 1WK 

SS50K 
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MEDIUM EFFORT 


WFES PHOTOTYPE SCOPE 

t KNOWLEDGE-BASE WILL BE RESTRICTED TO SCENARIOS RELATED TO 
SUMMERTIME THUNDERSTORMS WHICH FORM OVER KSC. 

t System logic will be fully functional with respect to 

DEFINING. EDITING, STORING, RETRIEVING AND EXECUTING 
SCENARIOS. 

• SYSTEM LOGIC WILL NOT PROVIDE FOR EITHER DYNAMIC OR 
AUTOMATIC MODIFICATION OF SCENARIOS. 

• WFES LINK TO MIDDS WILL BE A SERIAL LINK FOR PASSING OF DATA 
AND COMMANDS. 

• WFES WILL NOT PROVIDE AN INTERACTIVE INTERFACE TO EITHER 
MIDDS COMMAND STREAM OR DATA. 

• USER INTERFACE WILL BE USABLE BY DEVELOPERS AND SEVERAL 
TRAINED OTHERS. 

• NO USER DOCUMENTATION WILL BE PROVIDED. 

• NO OPERATIONAL TESTING WILL BE CONDUCTED. 
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